[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:35 dist-test-slave-kvfs krb5kdc[16328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:35 dist-test-slave-kvfs krb5kdc[16328](info): set up 2 sockets
Aug 10 04:50:35 dist-test-slave-kvfs krb5kdc[16328](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 04:50:36.872687 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.446s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:36 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:37.025043 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41209
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:41209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:37.126744 16350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:37.127084 16350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:37.127134 16350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:37.128590 16350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:37.128664 16350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:37.128687 16350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:37.128710 16350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:37.128765 16350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:37.130496 16350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:41209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:37.130856 16350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:37.131157 16350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:37.137323 16360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:37.137351 16350 server_base.cc:1034] running on GCE node
W20260810 04:50:37.137305 16357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:37.137312 16355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:37.137930 16350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:37.138307 16350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:37.139485 16350 hybrid_clock.cc:648] HybridClock initialized: now 1786337437139464 us; error 44 us; skew 500 ppm
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:37.142531 16350 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:37.143055 16350 webserver.cc:460] Webserver started at http://127.15.239.254:39895/ using document root <none> and password file <none>
I20260810 04:50:37.143275 16350 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:37.143318 16350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:37.143424 16350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:37.144760 16350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "3d3e99a0f2314515b928b3308fc3a1fb"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "60fc38d04cf12da9138c1efbbd0ea8c4"
server_key_iv: "719eb03c37f0d7d4b1edb950c2fb7153"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.145129 16350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "3d3e99a0f2314515b928b3308fc3a1fb"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "60fc38d04cf12da9138c1efbbd0ea8c4"
server_key_iv: "719eb03c37f0d7d4b1edb950c2fb7153"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.146621 16350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:50:37.147478 16368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.147732 16350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:37.147845 16350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "3d3e99a0f2314515b928b3308fc3a1fb"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "60fc38d04cf12da9138c1efbbd0ea8c4"
server_key_iv: "719eb03c37f0d7d4b1edb950c2fb7153"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.147910 16350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:37.163621 16350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:37.166424 16350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:37.166553 16350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:37.171470 16350 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:41209
I20260810 04:50:37.171576 16448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:41209 every 8 connection(s)
I20260810 04:50:37.172005 16350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:37.173085 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16350
I20260810 04:50:37.173192 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:37.173262 16451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:37.173947 16319 external_mini_cluster.cc:1428] Setting key 4ad612fa66db078339a634d1972482ee
I20260810 04:50:37.176824 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb: Bootstrap starting.
I20260810 04:50:37.177541 16451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:37.178025 16451 log.cc:824] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:37.178990 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb: No bootstrap required, opened a new log
I20260810 04:50:37.182946 16451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41209 } }
I20260810 04:50:37.183118 16451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:37.183143 16451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3e99a0f2314515b928b3308fc3a1fb, State: Initialized, Role: FOLLOWER
I20260810 04:50:37.183301 16451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41209 } }
I20260810 04:50:37.183388 16451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:37.183414 16451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:37.183446 16451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:37.184293 16451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41209 } }
I20260810 04:50:37.184419 16451 leader_election.cc:302] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d3e99a0f2314515b928b3308fc3a1fb; no voters:
I20260810 04:50:37.184618 16451 leader_election.cc:288] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:37.184727 16461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:37.184937 16461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [term 1 LEADER]: Becoming Leader. State: Replica: 3d3e99a0f2314515b928b3308fc3a1fb, State: Running, Role: LEADER
I20260810 04:50:37.184974 16451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:37.185106 16461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41209 } }
I20260810 04:50:37.185592 16461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3e99a0f2314515b928b3308fc3a1fb. Latest consensus state: current_term: 1 leader_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41209 } } }
I20260810 04:50:37.185807 16461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:37.185732 16463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e99a0f2314515b928b3308fc3a1fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41209 } } }
I20260810 04:50:37.186045 16463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:37.186447 16472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:37.187088 16472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:37.189150 16472 catalog_manager.cc:1347] Generated new cluster ID: 161c47ad6d0140139b2f4fdd5445b2b4
I20260810 04:50:37.189208 16472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:37.195101 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.175194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42262 (local address 127.15.239.254:41209)
0810 04:50:37.175423 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:37.175435 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:37.175722 (+ 287us) server_negotiation.cc:407] Connection header received
0810 04:50:37.178439 (+ 2717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:37.178447 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:37.178512 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:37.178692 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:37.180523 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.182402 (+ 1879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.183949 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.184649 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.185438 (+ 789us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.190232 (+ 4794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:37.190238 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:37.190238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:37.190252 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:37.192632 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.193206 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.193209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.193210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.193309 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.193610 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.193611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.193612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.193902 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:37.194222 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:37.194486 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 04:50:37.194634 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":99,"threads_started":1}
I20260810 04:50:37.198731 16472 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:37.199340 16472 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:37.212070 16472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d3e99a0f2314515b928b3308fc3a1fb: Generated new TSK 0
I20260810 04:50:37.212407 16472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:50:37.251381 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41209
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:37.349792 16490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:37.350040 16490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:37.350066 16490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:37.351292 16490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:37.351336 16490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:37.351362 16490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:37.352921 16490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41209
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:37.353142 16490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:37.353353 16490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:37.359263 16496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:37.359339 16495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:37.359277 16499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:37.359341 16490 server_base.cc:1034] running on GCE node
I20260810 04:50:37.359803 16490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:37.360155 16490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:37.361327 16490 hybrid_clock.cc:648] HybridClock initialized: now 1786337437361322 us; error 48 us; skew 500 ppm
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:37.364526 16490 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:37.364984 16490 webserver.cc:460] Webserver started at http://127.15.239.193:44657/ using document root <none> and password file <none>
I20260810 04:50:37.365193 16490 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:37.365235 16490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:37.365346 16490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:37.366514 16490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "6de15e852e8c42a586aef3672526129a"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "1ea253c072d4e0ca16ff71fbaf11bb87"
server_key_iv: "e78f951e2a63fa90d746185f19b45bea"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.366861 16490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "6de15e852e8c42a586aef3672526129a"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "1ea253c072d4e0ca16ff71fbaf11bb87"
server_key_iv: "e78f951e2a63fa90d746185f19b45bea"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.368379 16490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:50:37.369297 16510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.369555 16490 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:37.369688 16490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "6de15e852e8c42a586aef3672526129a"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "1ea253c072d4e0ca16ff71fbaf11bb87"
server_key_iv: "e78f951e2a63fa90d746185f19b45bea"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.369779 16490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:37.381484 16490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:37.384241 16490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:37.384470 16490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:37.384776 16490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:37.385169 16490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:37.385227 16490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.385278 16490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:37.385311 16490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.392892 16490 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:37617
I20260810 04:50:37.392952 16681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:37617 every 8 connection(s)
I20260810 04:50:37.393337 16490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:37.399590 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16490
I20260810 04:50:37.399714 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:37.399948 16319 external_mini_cluster.cc:1428] Setting key 348879ea58fecae03cd55bd1853b91ad
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:37.405222 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.394342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:57213 (local address 127.15.239.254:41209)
0810 04:50:37.394430 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:37.394431 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:37.394694 (+ 263us) server_negotiation.cc:407] Connection header received
0810 04:50:37.395367 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:37.395369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:37.395386 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:37.395448 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:37.396812 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.397414 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.398533 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.398789 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.398867 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.401898 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:37.401900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:37.401900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:37.401909 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:37.403527 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.404131 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.404132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.404133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.404208 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.404532 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.404533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.404533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.404652 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:37.404703 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:37.405064 (+ 361us) server_negotiation.cc:299] Negotiation successful
0810 04:50:37.405143 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:50:37.405560 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.394346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41209 (local address 127.15.239.193:57213)
0810 04:50:37.394549 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:37.394592 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:37.395223 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:37.395552 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:37.395556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:37.396427 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:37.396681 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:37.396687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.397536 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.397538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:37.398437 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:37.398439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.398894 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.398895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:37.399037 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.399666 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:37.399681 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:37.401772 (+ 2091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:37.403615 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:37.403623 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:37.403626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:37.403977 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:37.404282 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:37.404284 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:37.404284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:37.404456 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:37.404719 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:37.404727 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:37.404914 (+ 187us) client_negotiation.cc:769] Sending connection context
0810 04:50:37.405032 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:50:37.405240 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":101,"threads_started":1}
I20260810 04:50:37.406176 16682 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41209
I20260810 04:50:37.406313 16682 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:37.406580 16682 heartbeater.cc:511] Master 127.15.239.254:41209 requested a full tablet report, sending...
I20260810 04:50:37.407261 16394 ts_manager.cc:194] Registered new tserver with Master: 6de15e852e8c42a586aef3672526129a (127.15.239.193:37617)
I20260810 04:50:37.407986 16394 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:57213
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:50:37.431604 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41209
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:37.527536 16692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:37.527812 16692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:37.527839 16692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:37.529146 16692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:37.529196 16692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:37.529227 16692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:50:37.530745 16692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41209
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:37.530997 16692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:37.531225 16692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:37.537082 16702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:37.537078 16699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:37.537107 16698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:37.537503 16692 server_base.cc:1034] running on GCE node
I20260810 04:50:37.537756 16692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:37.538074 16692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:37.539264 16692 hybrid_clock.cc:648] HybridClock initialized: now 1786337437539232 us; error 46 us; skew 500 ppm
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:37.542502 16692 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:50:37.543118 16692 webserver.cc:460] Webserver started at http://127.15.239.194:46593/ using document root <none> and password file <none>
I20260810 04:50:37.543407 16692 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:37.543483 16692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:37.543675 16692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:37.545071 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "ebdcae2be56448ae919b7b7bedd42949"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "d8ea98fac6c3ac7d7dd7398bee8e23d7"
server_key_iv: "14d3f6918b57bc6904e16d411837116f"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.545528 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "ebdcae2be56448ae919b7b7bedd42949"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "d8ea98fac6c3ac7d7dd7398bee8e23d7"
server_key_iv: "14d3f6918b57bc6904e16d411837116f"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.547125 16692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:50:37.548139 16709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.548355 16692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:37.548501 16692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "ebdcae2be56448ae919b7b7bedd42949"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "d8ea98fac6c3ac7d7dd7398bee8e23d7"
server_key_iv: "14d3f6918b57bc6904e16d411837116f"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.548588 16692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:37.569855 16692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:37.572904 16692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:37.573125 16692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:37.573465 16692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:37.573927 16692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:37.574003 16692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.574054 16692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:37.574107 16692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.582237 16692 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:38613
I20260810 04:50:37.582281 16871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:38613 every 8 connection(s)
I20260810 04:50:37.582752 16692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:50:37.589138 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16692
I20260810 04:50:37.589255 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:50:37.589494 16319 external_mini_cluster.cc:1428] Setting key f2c0b2d0ece9865757fd13a1c4a409fd
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:37.595001 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.584011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:54507 (local address 127.15.239.254:41209)
0810 04:50:37.584140 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:37.584142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:37.584400 (+ 258us) server_negotiation.cc:407] Connection header received
0810 04:50:37.585185 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:37.585187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:37.585204 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:37.585282 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:37.586578 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.587201 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.588375 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.588602 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.588694 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.591526 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:37.591528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:37.591529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:37.591537 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:37.593350 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.593814 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.593815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.593815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.593901 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.594161 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.594162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.594162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.594334 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:37.594417 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:37.594715 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 04:50:37.594836 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 04:50:37.595043 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.583987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41209 (local address 127.15.239.194:54507)
0810 04:50:37.584243 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:37.584291 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:37.585050 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:37.585377 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:37.585382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:37.586219 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:37.586471 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:37.586476 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.587308 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.587310 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:37.588269 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:37.588272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.588705 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.588706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:37.588861 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.589650 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:37.589663 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:37.591421 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:37.593446 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:37.593454 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:37.593456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:37.593726 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:37.593972 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:37.593973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:37.593973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:37.594091 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:37.594406 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:37.594411 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:37.594557 (+ 146us) client_negotiation.cc:769] Sending connection context
0810 04:50:37.594661 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 04:50:37.594831 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":144,"threads_started":1}
I20260810 04:50:37.596125 16872 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41209
I20260810 04:50:37.596303 16872 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:37.596587 16872 heartbeater.cc:511] Master 127.15.239.254:41209 requested a full tablet report, sending...
I20260810 04:50:37.597177 16394 ts_manager.cc:194] Registered new tserver with Master: ebdcae2be56448ae919b7b7bedd42949 (127.15.239.194:38613)
I20260810 04:50:37.597630 16394 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:54507
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:50:37.624650 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41209
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:37.723968 16881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:37.724267 16881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:37.724295 16881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:37.725569 16881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:37.725616 16881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:37.725646 16881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:50:37.727219 16881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41209
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:37.727559 16881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:37.727839 16881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:37.733767 16888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:37.733870 16887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:37.733919 16881 server_base.cc:1034] running on GCE node
W20260810 04:50:37.733810 16892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:37.734208 16881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:37.734508 16881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:37.735680 16881 hybrid_clock.cc:648] HybridClock initialized: now 1786337437735678 us; error 39 us; skew 500 ppm
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:37.738549 16881 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:50:37.739081 16881 webserver.cc:460] Webserver started at http://127.15.239.195:39771/ using document root <none> and password file <none>
I20260810 04:50:37.739356 16881 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:37.739439 16881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:37.739606 16881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:37.740881 16881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "910b8d4f63544c7faa7adbc72b8f09bb"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "9aa1de8a1db074cf355211c965369dfa"
server_key_iv: "fca3453ab3050ece73979eb0917740c7"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.741303 16881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "910b8d4f63544c7faa7adbc72b8f09bb"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "9aa1de8a1db074cf355211c965369dfa"
server_key_iv: "fca3453ab3050ece73979eb0917740c7"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.742964 16881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:50:37.743922 16902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.744154 16881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:37.744269 16881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "910b8d4f63544c7faa7adbc72b8f09bb"
format_stamp: "Formatted at 2026-08-10 04:50:37 on dist-test-slave-kvfs"
server_key: "9aa1de8a1db074cf355211c965369dfa"
server_key_iv: "fca3453ab3050ece73979eb0917740c7"
server_key_version: "encryptionkey@0"
I20260810 04:50:37.744362 16881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:37.756928 16881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:37.759327 16881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:37.759518 16881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:37.759799 16881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:37.760299 16881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:37.760360 16881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.760409 16881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:37.760439 16881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:37.767679 16881 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:46827
I20260810 04:50:37.767728 17069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:46827 every 8 connection(s)
I20260810 04:50:37.768181 16881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:50:37.772429 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16881
I20260810 04:50:37.772526 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:50:37.772737 16319 external_mini_cluster.cc:1428] Setting key b08bf4a0379a5ee51f783be34f1cb7d0
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:37.779048 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.769032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:41061 (local address 127.15.239.254:41209)
0810 04:50:37.769128 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:37.769130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:37.769327 (+ 197us) server_negotiation.cc:407] Connection header received
0810 04:50:37.769913 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:37.769915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:37.769928 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:37.769984 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:37.771050 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.771641 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.773126 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.773379 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.773479 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.776171 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:37.776173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:37.776173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:37.776180 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:37.777702 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.778102 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.778103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.778103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.778160 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.778405 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.778405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.778406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.778529 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:37.778582 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:37.778899 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 04:50:37.778970 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:50:37.779294 17073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.768979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41209 (local address 127.15.239.195:41061)
0810 04:50:37.769187 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:37.769229 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:37.769816 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:37.770048 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:37.770052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:37.770708 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:37.770957 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:37.770962 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.771730 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.771732 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:37.773016 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:37.773020 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.773486 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.773488 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:37.773661 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.774368 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:37.774380 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:37.776070 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:37.777786 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:37.777792 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:37.777795 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:37.778033 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:37.778221 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:37.778221 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:37.778222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:37.778348 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:37.778623 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:37.778630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:37.778774 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 04:50:37.778875 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:50:37.779034 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":113,"threads_started":1}
I20260810 04:50:37.779844 17070 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41209
I20260810 04:50:37.779971 17070 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:37.780207 17070 heartbeater.cc:511] Master 127.15.239.254:41209 requested a full tablet report, sending...
I20260810 04:50:37.780664 16394 ts_manager.cc:194] Registered new tserver with Master: 910b8d4f63544c7faa7adbc72b8f09bb (127.15.239.195:46827)
I20260810 04:50:37.781103 16394 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:41061
I20260810 04:50:37.785140 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:50:37.812959 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.804494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.15.239.193:37617)
0810 04:50:37.804717 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:37.804723 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:37.804736 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:50:37.804772 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:37.804775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:37.804792 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:37.804871 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:37.805472 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.806257 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.806987 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.807393 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.807462 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.809891 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:37.809900 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:37.809901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:37.809910 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:37.811685 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.812115 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.812119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.812119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.812185 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.812382 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.812382 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.812383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.812549 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:37.812690 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:37.812758 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 04:50:37.812827 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":125,"threads_started":1}
W20260810 04:50:37.813452 16561 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49980
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[16328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:50:37.840256 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:37.832581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49986 (local address 127.15.239.193:37617)
0810 04:50:37.832643 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:37.832645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:37.832789 (+ 144us) server_negotiation.cc:407] Connection header received
0810 04:50:37.832831 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:37.832832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:37.832850 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:37.832918 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:37.833507 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.834074 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.834832 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:37.835089 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:37.835158 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:37.837691 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:37.837693 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:37.837693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:37.837701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:37.839107 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.839487 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.839488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.839488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.839544 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:37.839718 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:37.839718 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:37.839719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:37.839819 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:37.839923 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:37.840000 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 04:50:37.840150 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:50:37.840946 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16490
I20260810 04:50:37.859433 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16692
I20260810 04:50:37.872637 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16881
I20260810 04:50:37.884449 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16350
2026-08-10T04:50:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2500 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[17086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[17086](info): set up 2 sockets
Aug 10 04:50:37 dist-test-slave-kvfs krb5kdc[17086](info): commencing operation
krb5kdc: starting...
W20260810 04:50:39.182271 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:39.339695 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41567
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:41567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:39.437409 17109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:39.437712 17109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:39.437754 17109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:39.439018 17109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:39.439090 17109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:39.439116 17109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:39.439138 17109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:39.439181 17109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:39.440917 17109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:41567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:39.441267 17109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:39.441541 17109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:39.447695 17121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:39.447714 17119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:39.447706 17118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:39.448246 17109 server_base.cc:1034] running on GCE node
I20260810 04:50:39.448567 17109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:39.448900 17109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:39.450083 17109 hybrid_clock.cc:648] HybridClock initialized: now 1786337439450083 us; error 52 us; skew 500 ppm
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:39.458698 17109 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:39.459290 17109 webserver.cc:460] Webserver started at http://127.15.239.254:38601/ using document root <none> and password file <none>
I20260810 04:50:39.459602 17109 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:39.459683 17109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:39.459861 17109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:39.461277 17109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "12ac6db5d1424dfc844400fde5bbd468"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "12290c219951d8dbc550d46c58ac6e01"
server_key_iv: "ccfa9b0692cdd924a4e8875d1a700419"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.461745 17109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "12ac6db5d1424dfc844400fde5bbd468"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "12290c219951d8dbc550d46c58ac6e01"
server_key_iv: "ccfa9b0692cdd924a4e8875d1a700419"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.463438 17109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:50:39.464550 17132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.464823 17109 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:39.464962 17109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "12ac6db5d1424dfc844400fde5bbd468"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "12290c219951d8dbc550d46c58ac6e01"
server_key_iv: "ccfa9b0692cdd924a4e8875d1a700419"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.465058 17109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:39.487006 17109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:39.489955 17109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:39.490175 17109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:39.495388 17109 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:41567
I20260810 04:50:39.495431 17205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:41567 every 8 connection(s)
I20260810 04:50:39.495880 17109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:39.497149 17206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:39.497813 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17109
I20260810 04:50:39.497957 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:39.498164 16319 external_mini_cluster.cc:1428] Setting key 3803260bb37bf2f1ef7afe467286442b
I20260810 04:50:39.501029 17206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468: Bootstrap starting.
I20260810 04:50:39.501935 17206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:39.502312 17206 log.cc:824] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:39.503234 17206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468: No bootstrap required, opened a new log
I20260810 04:50:39.505856 17206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12ac6db5d1424dfc844400fde5bbd468" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41567 } }
I20260810 04:50:39.506085 17206 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:39.506141 17206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ac6db5d1424dfc844400fde5bbd468, State: Initialized, Role: FOLLOWER
I20260810 04:50:39.506311 17206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12ac6db5d1424dfc844400fde5bbd468" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41567 } }
I20260810 04:50:39.506448 17206 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:39.506490 17206 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:39.506558 17206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:39.507465 17206 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12ac6db5d1424dfc844400fde5bbd468" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41567 } }
I20260810 04:50:39.507624 17206 leader_election.cc:302] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12ac6db5d1424dfc844400fde5bbd468; no voters:
I20260810 04:50:39.507848 17206 leader_election.cc:288] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:39.507893 17216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:39.508056 17216 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [term 1 LEADER]: Becoming Leader. State: Replica: 12ac6db5d1424dfc844400fde5bbd468, State: Running, Role: LEADER
I20260810 04:50:39.508200 17216 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12ac6db5d1424dfc844400fde5bbd468" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41567 } }
I20260810 04:50:39.508253 17206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:39.508607 17216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12ac6db5d1424dfc844400fde5bbd468. Latest consensus state: current_term: 1 leader_uuid: "12ac6db5d1424dfc844400fde5bbd468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12ac6db5d1424dfc844400fde5bbd468" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41567 } } }
I20260810 04:50:39.508689 17216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:39.508884 17217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12ac6db5d1424dfc844400fde5bbd468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12ac6db5d1424dfc844400fde5bbd468" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41567 } } }
I20260810 04:50:39.508984 17217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:39.509781 17223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:39.510424 17223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:39.512157 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:39.498931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60098 (local address 127.15.239.254:41567)
0810 04:50:39.499179 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:39.499193 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:39.499247 (+ 54us) server_negotiation.cc:407] Connection header received
0810 04:50:39.499899 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:39.499911 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:39.499990 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:39.500203 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:39.500963 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.502606 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.503546 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.504313 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.504449 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:39.507444 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:39.507449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:39.507449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:39.507462 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:39.510191 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:39.510682 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:39.510685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:39.510686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:39.510800 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:39.511061 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:39.511062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:39.511062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:39.511402 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:39.511566 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:39.511733 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 04:50:39.511905 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
I20260810 04:50:39.512306 17223 catalog_manager.cc:1347] Generated new cluster ID: e33672d84b314bc0ae090ad1dc41fe74
I20260810 04:50:39.512342 17223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:50:39.533928 17223 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:39.534878 17223 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:39.539899 17223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12ac6db5d1424dfc844400fde5bbd468: Generated new TSK 0
I20260810 04:50:39.540194 17223 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:50:39.573686 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41567
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:39.674507 17244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:39.674764 17244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:39.674790 17244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:39.676012 17244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:39.676090 17244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:39.676119 17244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:39.677700 17244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:39.678004 17244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:39.678318 17244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:39.684324 17250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:39.684345 17251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:39.684393 17244 server_base.cc:1034] running on GCE node
W20260810 04:50:39.684324 17257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:39.684772 17244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:39.685077 17244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:39.686254 17244 hybrid_clock.cc:648] HybridClock initialized: now 1786337439686253 us; error 41 us; skew 500 ppm
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:39.689595 17244 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:39.690096 17244 webserver.cc:460] Webserver started at http://127.15.239.193:42013/ using document root <none> and password file <none>
I20260810 04:50:39.690373 17244 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:39.690425 17244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:39.690593 17244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:39.691927 17244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "552e43c728534e69852ddfd6dd498eed"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "1cac0ddcb55391110eedf41b30b2224c"
server_key_iv: "700dc0e7ed015a2ad31d37887cfa656a"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.692435 17244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "552e43c728534e69852ddfd6dd498eed"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "1cac0ddcb55391110eedf41b30b2224c"
server_key_iv: "700dc0e7ed015a2ad31d37887cfa656a"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.694088 17244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:50:39.695009 17264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.695268 17244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:39.695382 17244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "552e43c728534e69852ddfd6dd498eed"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "1cac0ddcb55391110eedf41b30b2224c"
server_key_iv: "700dc0e7ed015a2ad31d37887cfa656a"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.695449 17244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:39.708359 17244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:39.711006 17244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:39.711145 17244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:39.711385 17244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:39.711826 17244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:39.711867 17244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.711918 17244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:39.711948 17244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.719455 17244 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:41443
I20260810 04:50:39.719552 17444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:41443 every 8 connection(s)
I20260810 04:50:39.719992 17244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:39.722040 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17244
I20260810 04:50:39.722173 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:39.722393 16319 external_mini_cluster.cc:1428] Setting key 368627f69f79bb3b24c7de311a980866
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:39.733342 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:39.720968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:40799 (local address 127.15.239.254:41567)
0810 04:50:39.721045 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:39.721048 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:39.721290 (+ 242us) server_negotiation.cc:407] Connection header received
0810 04:50:39.722716 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:39.722718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:39.722736 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:39.722819 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:39.723983 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.724853 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.726382 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.726611 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.726673 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:39.729791 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:39.729793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:39.729794 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:39.729806 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:39.731551 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:39.732122 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:39.732125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:39.732125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:39.732201 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:39.732500 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:39.732502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:39.732502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:39.732649 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:39.732734 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:39.733095 (+ 361us) server_negotiation.cc:299] Negotiation successful
0810 04:50:39.733211 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:50:39.733577 17448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:39.720939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41567 (local address 127.15.239.193:40799)
0810 04:50:39.721131 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:39.721175 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:39.722541 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:39.723276 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:39.723282 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:39.723624 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:39.723865 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:39.723870 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.724969 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.724970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:39.726281 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:39.726286 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.726706 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.726707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:39.726883 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:39.727600 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:39.727613 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:39.729662 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:39.731666 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:39.731676 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:39.731680 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:39.731979 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:39.732282 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:39.732283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:39.732283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:39.732420 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:39.732735 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:39.732745 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:39.732929 (+ 184us) client_negotiation.cc:769] Sending connection context
0810 04:50:39.733057 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 04:50:39.733262 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
I20260810 04:50:39.734248 17445 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41567
I20260810 04:50:39.734369 17445 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:39.734566 17445 heartbeater.cc:511] Master 127.15.239.254:41567 requested a full tablet report, sending...
I20260810 04:50:39.735349 17163 ts_manager.cc:194] Registered new tserver with Master: 552e43c728534e69852ddfd6dd498eed (127.15.239.193:41443)
I20260810 04:50:39.736196 17163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:40799
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:50:39.756342 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41567
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:39.859894 17452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:39.860245 17452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:39.860275 17452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:39.861547 17452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:39.861590 17452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:39.861619 17452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:50:39.863265 17452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:39.863584 17452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:39.863871 17452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:39.869776 17467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:39.869781 17461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:39.869865 17463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:39.870047 17452 server_base.cc:1034] running on GCE node
I20260810 04:50:39.870307 17452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:39.870620 17452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:39.871775 17452 hybrid_clock.cc:648] HybridClock initialized: now 1786337439871746 us; error 53 us; skew 500 ppm
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:39.874984 17452 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:50:39.875555 17452 webserver.cc:460] Webserver started at http://127.15.239.194:38187/ using document root <none> and password file <none>
I20260810 04:50:39.875850 17452 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:39.875902 17452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:39.876114 17452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:39.877434 17452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "2ae833ffa89543d5b02c90ab78f00945"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "991f5e4df0ec6ab1e95404056200018c"
server_key_iv: "91c6e42588472949eb65dac506668f72"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.877877 17452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "2ae833ffa89543d5b02c90ab78f00945"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "991f5e4df0ec6ab1e95404056200018c"
server_key_iv: "91c6e42588472949eb65dac506668f72"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.879432 17452 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:50:39.880434 17477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.880618 17452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:39.880731 17452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "2ae833ffa89543d5b02c90ab78f00945"
format_stamp: "Formatted at 2026-08-10 04:50:39 on dist-test-slave-kvfs"
server_key: "991f5e4df0ec6ab1e95404056200018c"
server_key_iv: "91c6e42588472949eb65dac506668f72"
server_key_version: "encryptionkey@0"
I20260810 04:50:39.880806 17452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:39.908223 17452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:39.910969 17452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:39.911118 17452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:39.911366 17452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:39.911804 17452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:39.911854 17452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.911881 17452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:39.911921 17452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:39.919184 17452 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:41645
I20260810 04:50:39.919281 17648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:41645 every 8 connection(s)
I20260810 04:50:39.919706 17452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:50:39.926857 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17452
I20260810 04:50:39.926970 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:50:39.927213 16319 external_mini_cluster.cc:1428] Setting key b3357467dac6409bc37e2e2f482a2ba6
Aug 10 04:50:39 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:39.931878 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:39.920749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:44887 (local address 127.15.239.254:41567)
0810 04:50:39.920856 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:39.920860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:39.921091 (+ 231us) server_negotiation.cc:407] Connection header received
0810 04:50:39.922266 (+ 1175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:39.922268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:39.922285 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:39.922347 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:39.923174 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.923851 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.925011 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.925240 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.925335 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:39.928167 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:39.928169 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:39.928169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:39.928178 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:39.930048 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:39.930574 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:39.930576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:39.930576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:39.930654 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:39.931058 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:39.931059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:39.931059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:39.931188 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:39.931247 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:39.931700 (+ 453us) server_negotiation.cc:299] Negotiation successful
0810 04:50:39.931792 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:50:39.932287 17651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:39.920721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41567 (local address 127.15.239.194:44887)
0810 04:50:39.920928 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:39.920980 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:39.922127 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:39.922445 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:39.922452 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:39.922794 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:39.923046 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:39.923051 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.923956 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.923957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:39.924908 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:39.924911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:39.925349 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:39.925351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:39.925506 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:39.926178 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:39.926189 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:39.928029 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:39.930171 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:39.930181 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:39.930183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:39.930489 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:39.930759 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:39.930760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:39.930761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:39.930969 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:39.931262 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:39.931271 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:39.931511 (+ 240us) client_negotiation.cc:769] Sending connection context
0810 04:50:39.931659 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 04:50:39.931899 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260810 04:50:39.933049 17649 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41567
I20260810 04:50:39.933189 17649 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:39.933429 17649 heartbeater.cc:511] Master 127.15.239.254:41567 requested a full tablet report, sending...
I20260810 04:50:39.933946 17163 ts_manager.cc:194] Registered new tserver with Master: 2ae833ffa89543d5b02c90ab78f00945 (127.15.239.194:41645)
I20260810 04:50:39.934355 17163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:44887
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:50:39.960292 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41567
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:40.060000 17656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:40.060343 17656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:40.060372 17656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:40.061640 17656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:40.061685 17656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:40.061714 17656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:50:40.063400 17656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:40.063717 17656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:40.064011 17656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:40.070430 17666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:40.070430 17663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:40.070495 17664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:40.070717 17656 server_base.cc:1034] running on GCE node
I20260810 04:50:40.070963 17656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:40.071208 17656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:40.072427 17656 hybrid_clock.cc:648] HybridClock initialized: now 1786337440072409 us; error 34 us; skew 500 ppm
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337440, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:40.075546 17656 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:50:40.076171 17656 webserver.cc:460] Webserver started at http://127.15.239.195:40987/ using document root <none> and password file <none>
I20260810 04:50:40.076426 17656 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:40.076471 17656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:40.076576 17656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:40.077761 17656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "810c55a89a574f48bec9f03f48c275ce"
format_stamp: "Formatted at 2026-08-10 04:50:40 on dist-test-slave-kvfs"
server_key: "1699c8da65210e8c8336f3907ad98899"
server_key_iv: "431bbc32e4abb8c1eb6da11e4eafe6be"
server_key_version: "encryptionkey@0"
I20260810 04:50:40.078119 17656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "810c55a89a574f48bec9f03f48c275ce"
format_stamp: "Formatted at 2026-08-10 04:50:40 on dist-test-slave-kvfs"
server_key: "1699c8da65210e8c8336f3907ad98899"
server_key_iv: "431bbc32e4abb8c1eb6da11e4eafe6be"
server_key_version: "encryptionkey@0"
I20260810 04:50:40.079550 17656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:50:40.080364 17679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:40.080560 17656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:40.080669 17656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "810c55a89a574f48bec9f03f48c275ce"
format_stamp: "Formatted at 2026-08-10 04:50:40 on dist-test-slave-kvfs"
server_key: "1699c8da65210e8c8336f3907ad98899"
server_key_iv: "431bbc32e4abb8c1eb6da11e4eafe6be"
server_key_version: "encryptionkey@0"
I20260810 04:50:40.080734 17656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:40.102142 17656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:40.105027 17656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:40.105172 17656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:40.105424 17656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:40.105841 17656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:40.105881 17656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:40.105909 17656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:40.105957 17656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:40.113171 17656 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:46479
I20260810 04:50:40.113265 17848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:46479 every 8 connection(s)
I20260810 04:50:40.113677 17656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:50:40.118203 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17656
I20260810 04:50:40.118326 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:50:40.118552 16319 external_mini_cluster.cc:1428] Setting key 3cb3e2f04f0b24a6a91cd9ba50f3a2b3
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337440, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:40.126969 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.114730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:44617 (local address 127.15.239.254:41567)
0810 04:50:40.114807 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.114809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.115048 (+ 239us) server_negotiation.cc:407] Connection header received
0810 04:50:40.116215 (+ 1167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.116217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.116233 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.116316 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:40.117198 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.118287 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.120257 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.120522 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.120627 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.123494 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:40.123496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:40.123497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:40.123507 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:40.125305 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.125807 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.125808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.125809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.125884 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.126188 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.126188 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.126189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.126344 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:40.126426 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.126745 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.126857 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:50:40.127218 17852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.114673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41567 (local address 127.15.239.195:44617)
0810 04:50:40.114881 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:40.114939 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:40.116070 (+ 1131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:40.116431 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:40.116437 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:40.116772 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:40.117058 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.117063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.118438 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.118439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.120151 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.120156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.120640 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.120641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.120841 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.121581 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:40.121593 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:40.123370 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:40.125428 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:40.125437 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:40.125440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:40.125708 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:40.125958 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:40.125959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:40.125959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:40.126107 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:40.126416 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:40.126424 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:40.126599 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 04:50:40.126724 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 04:50:40.126923 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":115,"threads_started":1}
I20260810 04:50:40.128095 17849 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41567
I20260810 04:50:40.128217 17849 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:40.128422 17849 heartbeater.cc:511] Master 127.15.239.254:41567 requested a full tablet report, sending...
I20260810 04:50:40.128924 17163 ts_manager.cc:194] Registered new tserver with Master: 810c55a89a574f48bec9f03f48c275ce (127.15.239.195:46479)
I20260810 04:50:40.129405 17163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:44617
I20260810 04:50:40.131199 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:50:40.140502 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.133274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60100 (local address 127.15.239.254:41567)
0810 04:50:40.133339 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.133341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.133479 (+ 138us) server_negotiation.cc:407] Connection header received
0810 04:50:40.133527 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.133528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.133539 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.133596 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:40.134199 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.134731 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.135566 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.135761 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.135819 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.137259 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:40.137260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:40.137261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:40.137267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:40.138918 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.139418 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.139419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.139420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.139492 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.139714 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.139715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.139715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.139986 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:40.140157 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.140277 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.140380 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:50:40.143054 17163 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:50:40.145223 17163 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:40.153012 17864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.148296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:41443 (local address 127.0.0.1:34126)
0810 04:50:40.149337 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:40.149350 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:40.149407 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:40.149613 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:40.149614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:40.149617 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:40.149661 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.149662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.150867 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.150868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.151743 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.151746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.152620 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.152621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.152713 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.152732 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 04:50:40.152807 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 04:50:40.152883 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260810 04:50:40.153075 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.148559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54828 (local address 127.15.239.194:41645)
0810 04:50:40.148950 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.148956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.148966 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:50:40.149011 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.149014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.149031 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.149095 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:40.149294 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.150232 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.151856 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.152647 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.152760 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.152814 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.152911 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.152977 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":110,"threads_started":1}
I20260810 04:50:40.153141 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.148541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49106 (local address 127.15.239.195:46479)
0810 04:50:40.148833 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.148853 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.148866 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:50:40.148962 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.148965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.148986 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.149060 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:40.149355 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.150504 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.151860 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.152650 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.152704 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.152761 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.152997 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.153046 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":107,"threads_started":1}
I20260810 04:50:40.153508 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.148671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34126 (local address 127.15.239.193:41443)
0810 04:50:40.148993 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.148997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.149428 (+ 431us) server_negotiation.cc:407] Connection header received
0810 04:50:40.149492 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.149495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.149513 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.149599 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:40.149731 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.150766 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.151839 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.152497 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.152622 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.152700 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.153366 (+ 666us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.153418 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":109,"threads_started":1}
I20260810 04:50:40.153012 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.148291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:41645 (local address 127.0.0.1:54828)
0810 04:50:40.148694 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:40.148753 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:40.148832 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:40.149136 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:40.149139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:40.149141 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:40.149232 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.149234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.150356 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.150357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.151747 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.151750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.152763 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.152764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.152828 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.152832 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:40.152892 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:50:40.152932 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260810 04:50:40.153322 17861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.148291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:46479 (local address 127.0.0.1:49106)
0810 04:50:40.148762 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:40.148774 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:40.148838 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:40.149233 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:40.149234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:40.149236 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:40.149293 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.149294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.150619 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.150620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.151749 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.151750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.152824 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.152825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.152901 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.152904 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:50:40.153219 (+ 315us) client_negotiation.cc:240] Negotiation successful
0810 04:50:40.153271 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"mutex_wait_us":8,"thread_start_us":129,"threads_started":1}
I20260810 04:50:40.154532 17344 tablet_service.cc:1467] Processing CreateTablet for tablet 4660dbf679b548eebf5c2730f831aef3 (DEFAULT_TABLE table=test-table [id=b8c3ea86cde34b0ea84d3a5dc93b15fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:40.154560 17542 tablet_service.cc:1467] Processing CreateTablet for tablet 4660dbf679b548eebf5c2730f831aef3 (DEFAULT_TABLE table=test-table [id=b8c3ea86cde34b0ea84d3a5dc93b15fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:40.154942 17344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4660dbf679b548eebf5c2730f831aef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:40.154963 17542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4660dbf679b548eebf5c2730f831aef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:40.156939 17753 tablet_service.cc:1467] Processing CreateTablet for tablet 4660dbf679b548eebf5c2730f831aef3 (DEFAULT_TABLE table=test-table [id=b8c3ea86cde34b0ea84d3a5dc93b15fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:40.157366 17753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4660dbf679b548eebf5c2730f831aef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:40.158460 17871 tablet_bootstrap.cc:492] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: Bootstrap starting.
I20260810 04:50:40.159268 17871 tablet_bootstrap.cc:654] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:40.159933 17871 log.cc:824] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:40.160496 17873 tablet_bootstrap.cc:492] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: Bootstrap starting.
I20260810 04:50:40.160980 17871 tablet_bootstrap.cc:492] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: No bootstrap required, opened a new log
I20260810 04:50:40.161075 17871 ts_tablet_manager.cc:1397] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:50:40.161311 17873 tablet_bootstrap.cc:654] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:40.161587 17877 tablet_bootstrap.cc:492] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: Bootstrap starting.
I20260810 04:50:40.161998 17873 log.cc:824] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:40.162376 17877 tablet_bootstrap.cc:654] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:40.162817 17873 tablet_bootstrap.cc:492] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: No bootstrap required, opened a new log
I20260810 04:50:40.162914 17873 ts_tablet_manager.cc:1397] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:50:40.163043 17877 log.cc:824] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:40.163581 17871 raft_consensus.cc:348] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.163800 17871 raft_consensus.cc:374] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:40.163856 17871 raft_consensus.cc:729] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ae833ffa89543d5b02c90ab78f00945, State: Initialized, Role: FOLLOWER
I20260810 04:50:40.164112 17877 tablet_bootstrap.cc:492] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: No bootstrap required, opened a new log
I20260810 04:50:40.164000 17871 consensus_queue.cc:260] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.164297 17877 ts_tablet_manager.cc:1397] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:50:40.164397 17649 heartbeater.cc:503] Master 127.15.239.254:41567 was elected leader, sending a full tablet report...
I20260810 04:50:40.164742 17871 ts_tablet_manager.cc:1428] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 04:50:40.165326 17873 raft_consensus.cc:348] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.165544 17873 raft_consensus.cc:374] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:40.165599 17873 raft_consensus.cc:729] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 552e43c728534e69852ddfd6dd498eed, State: Initialized, Role: FOLLOWER
I20260810 04:50:40.165727 17873 consensus_queue.cc:260] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.166054 17873 ts_tablet_manager.cc:1428] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:50:40.166066 17445 heartbeater.cc:503] Master 127.15.239.254:41567 was elected leader, sending a full tablet report...
I20260810 04:50:40.166821 17877 raft_consensus.cc:348] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.166992 17877 raft_consensus.cc:374] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:40.167035 17877 raft_consensus.cc:729] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810c55a89a574f48bec9f03f48c275ce, State: Initialized, Role: FOLLOWER
I20260810 04:50:40.167151 17877 consensus_queue.cc:260] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.167461 17877 ts_tablet_manager.cc:1428] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:50:40.167480 17849 heartbeater.cc:503] Master 127.15.239.254:41567 was elected leader, sending a full tablet report...
W20260810 04:50:40.170439 17650 tablet.cc:2369] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:50:40.220992 17447 tablet.cc:2369] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:50:40.282980 17882 raft_consensus.cc:482] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:40.283170 17882 raft_consensus.cc:504] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.283780 17882 leader_election.cc:288] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ae833ffa89543d5b02c90ab78f00945 (127.15.239.194:41645), 552e43c728534e69852ddfd6dd498eed (127.15.239.193:41443)
I20260810 04:50:40.287036 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.284201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:49335 (local address 127.15.239.194:41645)
0810 04:50:40.284257 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.284259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.284271 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:40.284339 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.284340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.284352 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.284425 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:40.284641 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.285183 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.286210 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.286643 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.286734 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.286746 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.286912 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.286961 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:50:40.287036 17852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.284104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:41645 (local address 127.15.239.195:49335)
0810 04:50:40.284172 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:40.284186 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:40.284252 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:40.284448 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:40.284450 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:40.284453 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:40.284558 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.284561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.285300 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.285301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.286104 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.286106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.286743 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.286744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.286828 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.286832 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:40.286902 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:50:40.286947 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:50:40.287298 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.284118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:41443 (local address 127.15.239.195:54745)
0810 04:50:40.284552 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:40.284562 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:40.284646 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:40.284826 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:40.284827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:40.284829 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:40.284914 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.284915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.285628 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.285629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.286410 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:40.286412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.286976 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.286977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:40.287051 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.287058 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 04:50:40.287137 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 04:50:40.287193 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":162,"threads_started":1}
I20260810 04:50:40.287415 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.284163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:54745 (local address 127.15.239.193:41443)
0810 04:50:40.284223 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.284226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.284640 (+ 414us) server_negotiation.cc:407] Connection header received
0810 04:50:40.284712 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.284713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.284728 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.284821 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:40.284983 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.285525 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.286518 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.286887 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.286974 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.286983 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.287274 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.287325 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 04:50:40.287544 17576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4660dbf679b548eebf5c2730f831aef3" candidate_uuid: "810c55a89a574f48bec9f03f48c275ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ae833ffa89543d5b02c90ab78f00945" is_pre_election: true
I20260810 04:50:40.287779 17576 raft_consensus.cc:2454] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810c55a89a574f48bec9f03f48c275ce in term 0.
I20260810 04:50:40.287842 17373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4660dbf679b548eebf5c2730f831aef3" candidate_uuid: "810c55a89a574f48bec9f03f48c275ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552e43c728534e69852ddfd6dd498eed" is_pre_election: true
I20260810 04:50:40.288079 17373 raft_consensus.cc:2454] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810c55a89a574f48bec9f03f48c275ce in term 0.
I20260810 04:50:40.288146 17685 leader_election.cc:302] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ae833ffa89543d5b02c90ab78f00945, 810c55a89a574f48bec9f03f48c275ce; no voters:
I20260810 04:50:40.288303 17882 raft_consensus.cc:2781] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:40.288383 17882 raft_consensus.cc:482] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:40.288403 17882 raft_consensus.cc:3037] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:40.289335 17882 raft_consensus.cc:504] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.289500 17882 leader_election.cc:288] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [CANDIDATE]: Term 1 election: Requested vote from peers 2ae833ffa89543d5b02c90ab78f00945 (127.15.239.194:41645), 552e43c728534e69852ddfd6dd498eed (127.15.239.193:41443)
I20260810 04:50:40.289686 17576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4660dbf679b548eebf5c2730f831aef3" candidate_uuid: "810c55a89a574f48bec9f03f48c275ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ae833ffa89543d5b02c90ab78f00945"
I20260810 04:50:40.289733 17373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4660dbf679b548eebf5c2730f831aef3" candidate_uuid: "810c55a89a574f48bec9f03f48c275ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552e43c728534e69852ddfd6dd498eed"
I20260810 04:50:40.289800 17576 raft_consensus.cc:3037] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:40.289860 17373 raft_consensus.cc:3037] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:40.290762 17373 raft_consensus.cc:2454] T 4660dbf679b548eebf5c2730f831aef3 P 552e43c728534e69852ddfd6dd498eed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810c55a89a574f48bec9f03f48c275ce in term 1.
I20260810 04:50:40.290771 17576 raft_consensus.cc:2454] T 4660dbf679b548eebf5c2730f831aef3 P 2ae833ffa89543d5b02c90ab78f00945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810c55a89a574f48bec9f03f48c275ce in term 1.
I20260810 04:50:40.290977 17683 leader_election.cc:302] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 552e43c728534e69852ddfd6dd498eed, 810c55a89a574f48bec9f03f48c275ce; no voters:
I20260810 04:50:40.291136 17882 raft_consensus.cc:2781] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:40.291363 17882 raft_consensus.cc:686] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [term 1 LEADER]: Becoming Leader. State: Replica: 810c55a89a574f48bec9f03f48c275ce, State: Running, Role: LEADER
I20260810 04:50:40.291501 17882 consensus_queue.cc:237] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } }
I20260810 04:50:40.292667 17163 catalog_manager.cc:5495] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 810c55a89a574f48bec9f03f48c275ce (127.15.239.195). New cstate: current_term: 1 leader_uuid: "810c55a89a574f48bec9f03f48c275ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ae833ffa89543d5b02c90ab78f00945" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 41645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "552e43c728534e69852ddfd6dd498eed" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 41443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810c55a89a574f48bec9f03f48c275ce" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 46479 } health_report { overall_health: HEALTHY } } }
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:50:40.308197 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.299849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34130 (local address 127.15.239.193:41443)
0810 04:50:40.299905 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.299907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.300107 (+ 200us) server_negotiation.cc:407] Connection header received
0810 04:50:40.300196 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.300198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.300211 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.300259 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:40.300923 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.301451 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.302210 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.302421 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.302510 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.305146 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:40.305160 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:40.305160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:40.305168 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:40.306760 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.307140 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.307144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.307144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.307217 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.307443 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.307444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.307445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.307631 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:40.307767 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.307894 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.307968 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337440, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337440, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:50:40.337538 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.328496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34142 (local address 127.15.239.193:41443)
0810 04:50:40.328573 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.328576 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.328660 (+ 84us) server_negotiation.cc:407] Connection header received
0810 04:50:40.328773 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.328775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.328794 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.328861 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:40.329539 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.330105 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.330893 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.331123 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.331207 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.334125 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:40.334127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:40.334128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:40.334146 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:40.335751 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.336391 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.336393 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.336393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.336480 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.336733 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.336734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.336734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.336877 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:40.337018 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.337262 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.337393 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260810 04:50:40.364585 17851 tablet.cc:2369] T 4660dbf679b548eebf5c2730f831aef3 P 810c55a89a574f48bec9f03f48c275ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:50:40.369316 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:40.359728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34158 (local address 127.15.239.193:41443)
0810 04:50:40.359846 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:40.359849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:40.359974 (+ 125us) server_negotiation.cc:407] Connection header received
0810 04:50:40.360128 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:40.360129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:40.360151 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:40.360233 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:40.361003 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.361616 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.362760 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:40.362988 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:40.363097 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:40.366208 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:40.366210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:40.366210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:40.366221 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:40.367743 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.368257 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.368259 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.368259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.368335 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:40.368564 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:40.368565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:40.368566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:40.368707 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:40.368832 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:40.368946 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 04:50:40.369170 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260810 04:50:40.370031 17307 tablet_service.cc:2908] Rejecting scan request for tablet 4660dbf679b548eebf5c2730f831aef3: Uninitialized: clean time has not yet been initialized
I20260810 04:50:40.371474 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17244
I20260810 04:50:40.403283 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17452
I20260810 04:50:40.416119 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17656
I20260810 04:50:40.431196 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17109
2026-08-10T04:50:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2546 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17920](info): set up 2 sockets
Aug 10 04:50:40 dist-test-slave-kvfs krb5kdc[17920](info): commencing operation
krb5kdc: starting...
W20260810 04:50:41.734642 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:41 dist-test-slave-kvfs krb5kdc[17920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:41.883531 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37597
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:37597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:41.983721 17942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:41.984035 17942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:41.984093 17942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:41.985332 17942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:41.985417 17942 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 04:50:41.985440 17942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:41.985462 17942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:41.985491 17942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:41.985513 17942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:41.987134 17942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:37597
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:41.987457 17942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:41.987766 17942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:41.993813 17956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:41.993860 17967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:41.993907 17957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:41.994175 17942 server_base.cc:1034] running on GCE node
I20260810 04:50:41.994508 17942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:41.994912 17942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:41.996124 17942 hybrid_clock.cc:648] HybridClock initialized: now 1786337441996102 us; error 48 us; skew 500 ppm
Aug 10 04:50:41 dist-test-slave-kvfs krb5kdc[17920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337441, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:41.999181 17942 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:41.999673 17942 webserver.cc:460] Webserver started at http://127.15.239.254:38579/ using document root <none> and password file <none>
I20260810 04:50:41.999902 17942 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:41.999955 17942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:42.000133 17942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:42.001428 17942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "b7d713133ea14f8fbc2dc37c84d3cea5"
format_stamp: "Formatted at 2026-08-10 04:50:41 on dist-test-slave-kvfs"
server_key: "db84c211fdf4e789eae370e415cf3c94"
server_key_iv: "2f1804a18f0cbe3c4ff748053b733ed5"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.001796 17942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "b7d713133ea14f8fbc2dc37c84d3cea5"
format_stamp: "Formatted at 2026-08-10 04:50:41 on dist-test-slave-kvfs"
server_key: "db84c211fdf4e789eae370e415cf3c94"
server_key_iv: "2f1804a18f0cbe3c4ff748053b733ed5"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.003818 17942 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:50:42.004820 17974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.005088 17942 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:42.005216 17942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "b7d713133ea14f8fbc2dc37c84d3cea5"
format_stamp: "Formatted at 2026-08-10 04:50:41 on dist-test-slave-kvfs"
server_key: "db84c211fdf4e789eae370e415cf3c94"
server_key_iv: "2f1804a18f0cbe3c4ff748053b733ed5"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.005313 17942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:42.020350 17942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:42.023110 17942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:42.023311 17942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:42.030166 17942 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:37597
I20260810 04:50:42.030225 18077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:37597 every 8 connection(s)
I20260810 04:50:42.030655 17942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:42.031282 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17942
I20260810 04:50:42.031428 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:42.031682 16319 external_mini_cluster.cc:1428] Setting key f1aee83bd7decda3c0c95ace3fe516be
I20260810 04:50:42.031770 18083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.036078 18083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: Bootstrap starting.
I20260810 04:50:42.036938 18083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.037315 18083 log.cc:824] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:42.038290 18083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: No bootstrap required, opened a new log
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:42.040606 18083 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37597 } }
I20260810 04:50:42.040832 18083 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.040890 18083 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7d713133ea14f8fbc2dc37c84d3cea5, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.041062 18083 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37597 } }
I20260810 04:50:42.041137 18083 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:42.041229 18083 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:42.041296 18083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:42.042223 18083 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37597 } }
I20260810 04:50:42.042349 18083 leader_election.cc:302] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7d713133ea14f8fbc2dc37c84d3cea5; no voters:
I20260810 04:50:42.042541 18083 leader_election.cc:288] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:42.042622 18092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:42.042832 18092 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [term 1 LEADER]: Becoming Leader. State: Replica: b7d713133ea14f8fbc2dc37c84d3cea5, State: Running, Role: LEADER
I20260810 04:50:42.042963 18092 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37597 } }
I20260810 04:50:42.043067 18083 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:42.043521 18093 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37597 } } }
I20260810 04:50:42.043670 18093 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:42.043551 18094 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7d713133ea14f8fbc2dc37c84d3cea5. Latest consensus state: current_term: 1 leader_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7d713133ea14f8fbc2dc37c84d3cea5" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37597 } } }
I20260810 04:50:42.043951 18102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:42.044068 18094 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:42.044770 18102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:42.045693 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.032339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60610 (local address 127.15.239.254:37597)
0810 04:50:42.032574 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.032586 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.032629 (+ 43us) server_negotiation.cc:407] Connection header received
0810 04:50:42.033293 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.033305 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.033393 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.033581 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.034303 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.035801 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.036863 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.037564 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.037681 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.040534 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.040540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.040540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.040556 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.042977 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.043471 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.043475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.043476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.043605 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.043921 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.043922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.043923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.044344 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.044568 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.045242 (+ 674us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.045430 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":114,"threads_started":1}
I20260810 04:50:42.049460 18102 catalog_manager.cc:1347] Generated new cluster ID: 1e0c5fe2a2d4417289c1ba4523f7a5db
I20260810 04:50:42.049518 18102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:50:42.081025 18102 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:42.081748 18102 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:42.088924 18102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: Generated new TSK 0
I20260810 04:50:42.089172 18102 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:50:42.123790 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37597
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:42.254208 18131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:42.254490 18131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:42.254530 18131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:42.255784 18131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:42.255854 18131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:42.255889 18131 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:50:42.255928 18131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:42.257537 18131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:37597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:42.257838 18131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:42.258114 18131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:42.264112 18136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:42.264295 18131 server_base.cc:1034] running on GCE node
W20260810 04:50:42.264113 18141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:42.264086 18138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:42.264667 18131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:42.264993 18131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:42.266176 18131 hybrid_clock.cc:648] HybridClock initialized: now 1786337442266155 us; error 37 us; skew 500 ppm
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:42.269445 18131 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:42.269994 18131 webserver.cc:460] Webserver started at http://127.15.239.193:44443/ using document root <none> and password file <none>
I20260810 04:50:42.270258 18131 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:42.270340 18131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:42.270502 18131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:42.271770 18131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "e48a0e68bd1a49e1bd37913c5de16b38"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "dd7f9485b496cbb50f7b53ad03d267d8"
server_key_iv: "9f72da2b4a8b9247bfc378fb57ceb2f9"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.272221 18131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "e48a0e68bd1a49e1bd37913c5de16b38"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "dd7f9485b496cbb50f7b53ad03d267d8"
server_key_iv: "9f72da2b4a8b9247bfc378fb57ceb2f9"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.273823 18131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:42.274775 18150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.275077 18131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:42.275199 18131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "e48a0e68bd1a49e1bd37913c5de16b38"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "dd7f9485b496cbb50f7b53ad03d267d8"
server_key_iv: "9f72da2b4a8b9247bfc378fb57ceb2f9"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.275293 18131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:42.302646 18131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:42.305871 18131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:42.306031 18131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:42.306669 18131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:42.306710 18131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.306739 18131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:42.306753 18131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.315317 18131 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:34907
I20260810 04:50:42.315414 18339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:34907 every 8 connection(s)
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:42.315814 18131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:42.319666 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.307443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:54713 (local address 127.15.239.254:37597)
0810 04:50:42.307542 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.307546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.307828 (+ 282us) server_negotiation.cc:407] Connection header received
0810 04:50:42.308573 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.308574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.308591 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.308631 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.309667 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.310626 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.312411 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.312789 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.312890 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.316357 (+ 3467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.316359 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.316359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.316370 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.317889 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.318413 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.318415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.318415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.318491 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.318853 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.318854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.318855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.319033 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.319111 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.319483 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.319587 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 04:50:42.319839 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.307398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.15.239.193:54713)
0810 04:50:42.307629 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.307681 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.308430 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.308739 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.308744 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.309175 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:42.309525 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.309533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.310751 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.310752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.312324 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.312329 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.312907 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.312908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.313084 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.313901 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:42.313917 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:42.316251 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:42.318019 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.318027 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.318030 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.318290 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.318579 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.318580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.318581 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.318722 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.319127 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:42.319135 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:42.319301 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.319409 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.319570 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":144,"threads_started":1}
I20260810 04:50:42.320637 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18131
I20260810 04:50:42.320735 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:42.320960 16319 external_mini_cluster.cc:1428] Setting key f755beaf9ebce19f2551798729f84df2
I20260810 04:50:42.321185 18340 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37597
I20260810 04:50:42.321305 18340 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:42.321950 18340 heartbeater.cc:511] Master 127.15.239.254:37597 requested a full tablet report, sending...
I20260810 04:50:42.322664 17993 ts_manager.cc:194] Registered new tserver with Master: e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907)
I20260810 04:50:42.323418 17993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:54713
I20260810 04:50:42.329977 18346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.321954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.15.239.193:54281)
0810 04:50:42.322318 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.322331 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.322404 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.322527 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.322528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.322774 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:42.322865 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.322868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.323809 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.323810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.324664 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.324668 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.325025 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.325027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.325112 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.326150 (+ 1038us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:42.326156 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:42.326586 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:42.328817 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.328818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.328819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.329013 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.329274 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.329275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.329275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.329345 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.329672 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:42.329673 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:42.329717 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.329779 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.329878 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":198,"threads_started":1}
I20260810 04:50:42.330053 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.322005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:54281 (local address 127.15.239.254:37597)
0810 04:50:42.322054 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.322057 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.322413 (+ 356us) server_negotiation.cc:407] Connection header received
0810 04:50:42.322448 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.322449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.322462 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.322524 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.322950 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.323706 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.324750 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.324948 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.325006 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.326697 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.326699 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.326699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.326708 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.328708 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.329098 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.329100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.329100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.329174 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.329424 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.329425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.329426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.329597 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.329682 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.329818 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.329910 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:50:42.355473 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37597
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:42.451712 18350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:42.451995 18350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:42.452039 18350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:42.453382 18350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:42.453438 18350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:42.453460 18350 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:50:42.453480 18350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:50:42.455080 18350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:37597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:42.455402 18350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:42.455711 18350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:42.462054 18356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:42.462013 18355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:42.462013 18361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:42.462365 18350 server_base.cc:1034] running on GCE node
I20260810 04:50:42.462682 18350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:42.462981 18350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:42.464160 18350 hybrid_clock.cc:648] HybridClock initialized: now 1786337442464130 us; error 51 us; skew 500 ppm
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:42.467430 18350 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:50:42.468097 18350 webserver.cc:460] Webserver started at http://127.15.239.194:34831/ using document root <none> and password file <none>
I20260810 04:50:42.468343 18350 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:42.468396 18350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:42.468511 18350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:42.469769 18350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "253e66aa92b844d88e2630aa676d5568"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "a4db41df1bea8e866e1b171c16cba9a3"
server_key_iv: "21f82b3b958e5bfab4e28ca2348f1e38"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.470146 18350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "253e66aa92b844d88e2630aa676d5568"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "a4db41df1bea8e866e1b171c16cba9a3"
server_key_iv: "21f82b3b958e5bfab4e28ca2348f1e38"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.471801 18350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:50:42.472873 18369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.473186 18350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:42.473328 18350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "253e66aa92b844d88e2630aa676d5568"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "a4db41df1bea8e866e1b171c16cba9a3"
server_key_iv: "21f82b3b958e5bfab4e28ca2348f1e38"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.473439 18350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:42.490435 18350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:42.493407 18350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:42.493606 18350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:42.494379 18350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:42.494426 18350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.494453 18350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:42.494467 18350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:42.503525 18350 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:35245
I20260810 04:50:42.504077 18350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:50:42.504058 18554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:35245 every 8 connection(s)
I20260810 04:50:42.506518 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.495124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:39805 (local address 127.15.239.254:37597)
0810 04:50:42.495214 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.495217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.495530 (+ 313us) server_negotiation.cc:407] Connection header received
0810 04:50:42.496566 (+ 1036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.496568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.496588 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.496696 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.497522 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.498132 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.499314 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.499554 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.499648 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.502992 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.502995 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.502996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.503008 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.504957 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.505420 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.505421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.505421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.505484 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.505818 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.505818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.505819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.505983 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.506040 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.506351 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.506437 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:50:42.506839 18383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.495091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.15.239.194:39805)
0810 04:50:42.495328 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.495391 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.496387 (+ 996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.496802 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.496810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.497157 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:42.497411 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.497416 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.498241 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.498242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.499211 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.499214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.499661 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.499662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.499836 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.500571 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:42.500603 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:42.502870 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:42.505060 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.505067 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.505070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.505345 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.505573 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.505575 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.505575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.505721 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.506060 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:42.506067 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:42.506217 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.506326 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.506494 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":116,"threads_started":1}
I20260810 04:50:42.507457 18557 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37597
I20260810 04:50:42.507586 18557 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:42.507822 18557 heartbeater.cc:511] Master 127.15.239.254:37597 requested a full tablet report, sending...
I20260810 04:50:42.508349 17993 ts_manager.cc:194] Registered new tserver with Master: 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245)
I20260810 04:50:42.508796 17993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:39805
I20260810 04:50:42.513398 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18350
I20260810 04:50:42.513497 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:50:42.513733 16319 external_mini_cluster.cc:1428] Setting key 8ef16bf531c0a4ac44313d363ce18389
I20260810 04:50:42.515283 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.509041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.15.239.194:34791)
0810 04:50:42.509213 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.509225 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.509307 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.509477 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.509478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.509669 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:42.509731 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.509733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.510484 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.510485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.511026 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.511027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.511402 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.511402 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.511468 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.512046 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:42.512052 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:42.512415 (+ 363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:42.514036 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.514037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.514038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.514228 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.514462 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.514462 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.514463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.514547 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.514991 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:42.514992 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:42.515037 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.515104 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.515199 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260810 04:50:42.515398 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.509111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:34791 (local address 127.15.239.254:37597)
0810 04:50:42.509150 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.509152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.509305 (+ 153us) server_negotiation.cc:407] Connection header received
0810 04:50:42.509397 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.509399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.509411 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.509474 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.509814 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.510372 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.511127 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.511324 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.511389 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.512494 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.512496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.512496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.512503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.513963 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.514295 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.514296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.514296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.514366 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.514621 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.514622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.514623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.514881 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.514981 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.515158 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.515257 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:50:42.547869 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37597
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:42.645725 18568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:42.646034 18568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:42.646075 18568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:42.647344 18568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:42.647418 18568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:42.647452 18568 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:50:42.647521 18568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:50:42.649183 18568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:37597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:42.649489 18568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:42.649765 18568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:42.655895 18585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:42.655908 18581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:42.655956 18582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:42.656149 18568 server_base.cc:1034] running on GCE node
I20260810 04:50:42.656417 18568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:42.656755 18568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:42.657912 18568 hybrid_clock.cc:648] HybridClock initialized: now 1786337442657904 us; error 55 us; skew 500 ppm
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:42.661073 18568 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:50:42.661638 18568 webserver.cc:460] Webserver started at http://127.15.239.195:41631/ using document root <none> and password file <none>
I20260810 04:50:42.661916 18568 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:42.661978 18568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:42.662129 18568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:42.663378 18568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "c7d98448a01241b2b64b8b7b9d7bc48b"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "11ba3bc6ef55e5ddc13bce1febd9713a"
server_key_iv: "4b08de0b8f2091667a214416d7d65ce8"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.663786 18568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "c7d98448a01241b2b64b8b7b9d7bc48b"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "11ba3bc6ef55e5ddc13bce1febd9713a"
server_key_iv: "4b08de0b8f2091667a214416d7d65ce8"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.665418 18568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:50:42.666415 18596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.666651 18568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:42.666774 18568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "c7d98448a01241b2b64b8b7b9d7bc48b"
format_stamp: "Formatted at 2026-08-10 04:50:42 on dist-test-slave-kvfs"
server_key: "11ba3bc6ef55e5ddc13bce1febd9713a"
server_key_iv: "4b08de0b8f2091667a214416d7d65ce8"
server_key_version: "encryptionkey@0"
I20260810 04:50:42.666858 18568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:42.674132 18568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:42.677865 18568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:42.678119 18568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:42.678777 18568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:42.678848 18568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.678896 18568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:42.678931 18568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.686897 18568 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:40937
I20260810 04:50:42.687151 18778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:40937 every 8 connection(s)
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:42.687463 18568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:50:42.691100 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.679483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:45265 (local address 127.15.239.254:37597)
0810 04:50:42.679560 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.679567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.679800 (+ 233us) server_negotiation.cc:407] Connection header received
0810 04:50:42.680531 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.680534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.680557 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.680653 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.681703 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.682668 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.684412 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.684780 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.684868 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.688062 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.688064 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.688064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.688082 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.689751 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.690165 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.690166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.690166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.690225 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.690458 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.690458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.690458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.690590 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.690645 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.690914 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.691019 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:50:42.691313 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.679483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.15.239.195:45265)
0810 04:50:42.679667 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.679708 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.680392 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.680722 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.680726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.681220 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:42.681573 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.681580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.682789 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.682790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.684305 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.684308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.684876 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.684877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.685020 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.685751 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:42.685763 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:42.687909 (+ 2146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:42.689836 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.689843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.689846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.690092 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.690286 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.690286 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.690287 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.690396 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.690647 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:42.690652 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:42.690795 (+ 143us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.690888 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.691043 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":103,"threads_started":1}
I20260810 04:50:42.691915 18779 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37597
I20260810 04:50:42.692054 18779 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:42.692277 18779 heartbeater.cc:511] Master 127.15.239.254:37597 requested a full tablet report, sending...
I20260810 04:50:42.692894 17993 ts_manager.cc:194] Registered new tserver with Master: c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937)
I20260810 04:50:42.693392 17993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:45265
I20260810 04:50:42.695912 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18568
I20260810 04:50:42.696051 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:50:42.696288 16319 external_mini_cluster.cc:1428] Setting key 3b9011ecc57fcff7eb11e435c1f35b10
I20260810 04:50:42.697773 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:50:42.700346 18785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.693212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.15.239.195:33047)
0810 04:50:42.693385 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.693401 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.693484 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.693616 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.693617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.693864 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:42.693961 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.693963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.694821 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.694823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.695725 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.695727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.696281 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.696282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.696374 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.696846 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:42.696851 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:42.697324 (+ 473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:42.699167 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.699168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.699169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.699363 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.699617 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:42.699618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:42.699619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:42.699691 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:42.699993 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:42.699994 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:42.700091 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.700165 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.700266 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260810 04:50:42.700455 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.693274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:33047 (local address 127.15.239.254:37597)
0810 04:50:42.693326 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.693328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.693471 (+ 143us) server_negotiation.cc:407] Connection header received
0810 04:50:42.693537 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.693538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.693549 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.693611 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.694039 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.694724 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.695852 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.696202 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.696262 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.697408 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.697409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.697409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.697421 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.699068 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.699453 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.699454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.699454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.699527 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.699769 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.699769 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.699770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.699929 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.700007 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.700211 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.700304 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:50:42 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:42.727803 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.719335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60612 (local address 127.15.239.254:37597)
0810 04:50:42.719469 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.719471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.719483 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:42.719527 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.719528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.719540 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.719648 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:42.720477 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.721115 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.721920 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.722145 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.722230 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.725048 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:42.725050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:42.725050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:42.725069 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:42.726465 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.726884 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.726886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.726886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.726963 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:42.727175 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:42.727176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:42.727176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:42.727312 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:42.727440 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.727582 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.727678 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:50:42.729720 17993 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:50:42.731729 17993 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:42.740013 18801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.734757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34907 (local address 127.0.0.1:47960)
0810 04:50:42.735229 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.735307 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.735418 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.735723 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.735727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.735729 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:42.735832 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.735834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.737191 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.737192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.738735 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.738738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.739752 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.739820 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.739824 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.739877 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.739927 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":93,"threads_started":1}
I20260810 04:50:42.740037 18797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.734757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:40937 (local address 127.0.0.1:47328)
0810 04:50:42.735337 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.735348 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.735421 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.735873 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.735874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.735877 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:42.735952 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.735953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.737392 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.737393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.738534 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.738537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.739531 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.739617 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.739634 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.739725 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.739789 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":5,"thread_start_us":103,"threads_started":1}
I20260810 04:50:42.740340 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.735014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47960 (local address 127.15.239.193:34907)
0810 04:50:42.735277 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.735284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.735531 (+ 247us) server_negotiation.cc:407] Connection header received
0810 04:50:42.735597 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.735600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.735619 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.735717 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:42.735903 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.737069 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.738831 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.739573 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739640 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.739694 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.740163 (+ 469us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.740222 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":110,"threads_started":1}
I20260810 04:50:42.739943 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.735206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47328 (local address 127.15.239.195:40937)
0810 04:50:42.735683 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.735688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.735700 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:42.735742 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.735744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.735760 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.735855 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:42.736072 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.737281 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.738638 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.739436 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739522 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.739594 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.739753 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.739798 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":122,"threads_started":1}
I20260810 04:50:42.740765 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.735249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50946 (local address 127.15.239.194:35245)
0810 04:50:42.735573 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.735578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.736159 (+ 581us) server_negotiation.cc:407] Connection header received
0810 04:50:42.736216 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.736219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.736236 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.736320 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:42.736519 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.737638 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739074 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.739692 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739761 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.739815 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.740595 (+ 780us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.740654 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":145,"threads_started":1}
I20260810 04:50:42.740947 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.735018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:35245 (local address 127.0.0.1:50946)
0810 04:50:42.735979 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.735987 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.736081 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.736355 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.736356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.736358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:42.736427 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.736428 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.737720 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.737721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.738983 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.738985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.739861 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.739862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.739935 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.739939 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.739992 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.740884 (+ 892us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"thread_start_us":95,"threads_started":1}
I20260810 04:50:42.741226 18234 tablet_service.cc:1467] Processing CreateTablet for tablet d182df4cb2344588a4baeca9bbca055a (DEFAULT_TABLE table=test-table [id=5f997c092fb044199a3d879a58ec5082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:42.741706 18234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d182df4cb2344588a4baeca9bbca055a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.741688 18446 tablet_service.cc:1467] Processing CreateTablet for tablet d182df4cb2344588a4baeca9bbca055a (DEFAULT_TABLE table=test-table [id=5f997c092fb044199a3d879a58ec5082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:42.742120 18446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d182df4cb2344588a4baeca9bbca055a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.745654 18811 tablet_bootstrap.cc:492] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Bootstrap starting.
I20260810 04:50:42.745656 18810 tablet_bootstrap.cc:492] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Bootstrap starting.
I20260810 04:50:42.746256 18669 tablet_service.cc:1467] Processing CreateTablet for tablet d182df4cb2344588a4baeca9bbca055a (DEFAULT_TABLE table=test-table [id=5f997c092fb044199a3d879a58ec5082]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:42.746464 18811 tablet_bootstrap.cc:654] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.746543 18810 tablet_bootstrap.cc:654] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.746699 18669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d182df4cb2344588a4baeca9bbca055a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.746857 18811 log.cc:824] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:42.746923 18810 log.cc:824] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:42.747656 18811 tablet_bootstrap.cc:492] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: No bootstrap required, opened a new log
I20260810 04:50:42.747697 18810 tablet_bootstrap.cc:492] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: No bootstrap required, opened a new log
I20260810 04:50:42.747747 18811 ts_tablet_manager.cc:1397] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:50:42.747758 18810 ts_tablet_manager.cc:1397] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:50:42.749344 18811 raft_consensus.cc:348] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.749521 18811 raft_consensus.cc:374] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.749569 18811 raft_consensus.cc:729] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253e66aa92b844d88e2630aa676d5568, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.749717 18811 consensus_queue.cc:260] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.750027 18557 heartbeater.cc:503] Master 127.15.239.254:37597 was elected leader, sending a full tablet report...
I20260810 04:50:42.749955 18810 raft_consensus.cc:348] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.750130 18810 raft_consensus.cc:374] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.750181 18810 raft_consensus.cc:729] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48a0e68bd1a49e1bd37913c5de16b38, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.750304 18810 consensus_queue.cc:260] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.750386 18811 ts_tablet_manager.cc:1428] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:50:42.750608 18810 ts_tablet_manager.cc:1428] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:50:42.750758 18340 heartbeater.cc:503] Master 127.15.239.254:37597 was elected leader, sending a full tablet report...
I20260810 04:50:42.751456 18816 tablet_bootstrap.cc:492] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Bootstrap starting.
I20260810 04:50:42.752597 18816 tablet_bootstrap.cc:654] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.752948 18816 log.cc:824] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:42.753754 18816 tablet_bootstrap.cc:492] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: No bootstrap required, opened a new log
I20260810 04:50:42.753814 18816 ts_tablet_manager.cc:1397] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
W20260810 04:50:42.754727 18558 tablet.cc:2369] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:50:42.755625 18816 raft_consensus.cc:348] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.755771 18816 raft_consensus.cc:374] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.755795 18816 raft_consensus.cc:729] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d98448a01241b2b64b8b7b9d7bc48b, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.755934 18816 consensus_queue.cc:260] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.756251 18816 ts_tablet_manager.cc:1428] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:50:42.756328 18779 heartbeater.cc:503] Master 127.15.239.254:37597 was elected leader, sending a full tablet report...
W20260810 04:50:42.816911 18341 tablet.cc:2369] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:50:42.836921 18820 raft_consensus.cc:482] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:42.837168 18820 raft_consensus.cc:504] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.837723 18820 leader_election.cc:288] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245), e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907)
I20260810 04:50:42.842296 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.838119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:38847 (local address 127.15.239.194:35245)
0810 04:50:42.838210 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.838213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.838225 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:42.838286 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.838288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.838302 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.838377 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:42.838623 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.839499 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.841158 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.841761 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.841862 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.841877 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.842144 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.842201 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 04:50:42.842288 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.838225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:43113 (local address 127.15.239.193:34907)
0810 04:50:42.838284 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.838287 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.838445 (+ 158us) server_negotiation.cc:407] Connection header received
0810 04:50:42.838494 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.838495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.838505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.838559 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:42.838747 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.839499 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.841164 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.841812 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.841889 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.841899 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.842145 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.842203 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:50:42.842286 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.838001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:35245 (local address 127.15.239.195:38847)
0810 04:50:42.838073 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.838088 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.838150 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.838414 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.838416 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.838418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:42.838519 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.838521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.839600 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.839601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.841038 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.841041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.841913 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.841915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.842048 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.842051 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.842124 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.842163 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":147}
I20260810 04:50:42.842295 18823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.838078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34907 (local address 127.15.239.195:43113)
0810 04:50:42.838321 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:42.838331 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:42.838415 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:42.838580 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:42.838581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:42.838583 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:42.838660 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.838666 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.839600 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.839601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.841036 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:42.841041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.841919 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.841920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:42.842030 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.842035 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:50:42.842108 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:50:42.842163 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":58,"thread_start_us":169,"threads_started":1}
I20260810 04:50:42.842854 18481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d182df4cb2344588a4baeca9bbca055a" candidate_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253e66aa92b844d88e2630aa676d5568" is_pre_election: true
I20260810 04:50:42.842859 18268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d182df4cb2344588a4baeca9bbca055a" candidate_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" is_pre_election: true
I20260810 04:50:42.843083 18481 raft_consensus.cc:2454] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7d98448a01241b2b64b8b7b9d7bc48b in term 0.
I20260810 04:50:42.843089 18268 raft_consensus.cc:2454] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7d98448a01241b2b64b8b7b9d7bc48b in term 0.
I20260810 04:50:42.843397 18600 leader_election.cc:302] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7d98448a01241b2b64b8b7b9d7bc48b, e48a0e68bd1a49e1bd37913c5de16b38; no voters:
I20260810 04:50:42.843588 18820 raft_consensus.cc:2781] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:42.843704 18820 raft_consensus.cc:482] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:42.843760 18820 raft_consensus.cc:3037] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:42.844910 18820 raft_consensus.cc:504] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.845117 18820 leader_election.cc:288] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [CANDIDATE]: Term 1 election: Requested vote from peers 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245), e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907)
I20260810 04:50:42.845319 18268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d182df4cb2344588a4baeca9bbca055a" candidate_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48a0e68bd1a49e1bd37913c5de16b38"
I20260810 04:50:42.845341 18481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d182df4cb2344588a4baeca9bbca055a" candidate_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253e66aa92b844d88e2630aa676d5568"
I20260810 04:50:42.845438 18268 raft_consensus.cc:3037] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:42.845454 18481 raft_consensus.cc:3037] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:42.846339 18481 raft_consensus.cc:2454] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7d98448a01241b2b64b8b7b9d7bc48b in term 1.
I20260810 04:50:42.846350 18268 raft_consensus.cc:2454] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7d98448a01241b2b64b8b7b9d7bc48b in term 1.
I20260810 04:50:42.846899 18598 leader_election.cc:302] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253e66aa92b844d88e2630aa676d5568, c7d98448a01241b2b64b8b7b9d7bc48b; no voters:
I20260810 04:50:42.847046 18820 raft_consensus.cc:2781] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:42.847306 18820 raft_consensus.cc:686] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 LEADER]: Becoming Leader. State: Replica: c7d98448a01241b2b64b8b7b9d7bc48b, State: Running, Role: LEADER
I20260810 04:50:42.847452 18820 consensus_queue.cc:237] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } }
I20260810 04:50:42.848690 17995 catalog_manager.cc:5495] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195). New cstate: current_term: 1 leader_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } health_report { overall_health: UNKNOWN } } }
I20260810 04:50:42.861115 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:42.858471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47342 (local address 127.15.239.195:40937)
0810 04:50:42.858526 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:42.858528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:42.858536 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:50:42.858570 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:42.858571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:42.858589 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:42.858654 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:42.858819 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.859318 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.860217 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:42.860432 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:42.860546 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:42.860767 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:42.860896 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:42.860977 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:42.861021 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 04:50:42.861046 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:50:42.863451 18268 raft_consensus.cc:1261] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Refusing update from remote peer c7d98448a01241b2b64b8b7b9d7bc48b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:42.863446 18481 raft_consensus.cc:1261] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Refusing update from remote peer c7d98448a01241b2b64b8b7b9d7bc48b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:42.863885 18824 consensus_queue.cc:1035] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [LEADER]: Connected to new peer: Peer: permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:42.864081 18820 consensus_queue.cc:1035] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:42.866930 18831 mvcc.cc:205] Tried to move back new op lower bound from 7316838165965426688 to 7316838165904388096. Current Snapshot: MvccSnapshot[applied={T|T < 7316838165965426688}]
I20260810 04:50:42.867784 18830 mvcc.cc:205] Tried to move back new op lower bound from 7316838165965426688 to 7316838165904388096. Current Snapshot: MvccSnapshot[applied={T|T < 7316838165965426688}]
I20260810 04:50:42.872190 17995 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:42.872360 17995 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:42.873487 17995 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: Sending DeleteTablet for 3 replicas of tablet d182df4cb2344588a4baeca9bbca055a
I20260810 04:50:42.873891 18669 tablet_service.cc:1514] Processing DeleteTablet for tablet d182df4cb2344588a4baeca9bbca055a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:42 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:47328
I20260810 04:50:42.873968 18234 tablet_service.cc:1514] Processing DeleteTablet for tablet d182df4cb2344588a4baeca9bbca055a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:42 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:47960
I20260810 04:50:42.873974 18446 tablet_service.cc:1514] Processing DeleteTablet for tablet d182df4cb2344588a4baeca9bbca055a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:42 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:50946
I20260810 04:50:42.874218 18846 tablet_replica.cc:330] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: stopping tablet replica
I20260810 04:50:42.874372 18846 raft_consensus.cc:2229] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:42.874526 18846 raft_consensus.cc:2258] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:42.874599 17995 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:50:42.874788 17995 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:42.875099 18846 ts_tablet_manager.cc:1905] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:42.875130 18847 tablet_replica.cc:330] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: stopping tablet replica
I20260810 04:50:42.875379 18847 raft_consensus.cc:2229] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:42.875577 18847 raft_consensus.cc:2258] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:42.876322 18234 tablet_service.cc:1467] Processing CreateTablet for tablet 03b812bbb664494dbbe7635d431fcaf4 (DEFAULT_TABLE table=test-table [id=6bba3214f0734d7c8c4adb82f2188ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:42.876451 18446 tablet_service.cc:1467] Processing CreateTablet for tablet 03b812bbb664494dbbe7635d431fcaf4 (DEFAULT_TABLE table=test-table [id=6bba3214f0734d7c8c4adb82f2188ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:42.876598 18446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03b812bbb664494dbbe7635d431fcaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.876706 18234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03b812bbb664494dbbe7635d431fcaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.877589 18846 ts_tablet_manager.cc:1918] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:50:42.877744 18846 log.cc:1196] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/d182df4cb2344588a4baeca9bbca055a
I20260810 04:50:42.878068 18846 ts_tablet_manager.cc:1939] T d182df4cb2344588a4baeca9bbca055a P e48a0e68bd1a49e1bd37913c5de16b38: Deleting consensus metadata
I20260810 04:50:42.878515 18811 tablet_bootstrap.cc:492] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Bootstrap starting.
I20260810 04:50:42.878585 18669 tablet_service.cc:1467] Processing CreateTablet for tablet 03b812bbb664494dbbe7635d431fcaf4 (DEFAULT_TABLE table=test-table [id=6bba3214f0734d7c8c4adb82f2188ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:42.878731 18669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03b812bbb664494dbbe7635d431fcaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:42.879006 18811 tablet_bootstrap.cc:654] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.879560 17978 catalog_manager.cc:4841] TS e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907): tablet d182df4cb2344588a4baeca9bbca055a (table test-table [id=5f997c092fb044199a3d879a58ec5082]) successfully deleted
I20260810 04:50:42.879737 18811 tablet_bootstrap.cc:492] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: No bootstrap required, opened a new log
I20260810 04:50:42.879786 18811 ts_tablet_manager.cc:1397] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:42.879885 18845 tablet_replica.cc:330] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: stopping tablet replica
I20260810 04:50:42.879997 18845 raft_consensus.cc:2229] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:50:42.879966 18811 raft_consensus.cc:348] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:42.880074 18811 raft_consensus.cc:374] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.880107 18811 raft_consensus.cc:729] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253e66aa92b844d88e2630aa676d5568, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.880168 18811 consensus_queue.cc:260] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:42.880213 18816 tablet_bootstrap.cc:492] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Bootstrap starting.
I20260810 04:50:42.880295 18811 ts_tablet_manager.cc:1428] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:42.880405 18810 tablet_bootstrap.cc:492] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Bootstrap starting.
I20260810 04:50:42.880697 18816 tablet_bootstrap.cc:654] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.880831 18810 tablet_bootstrap.cc:654] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:42.880172 18845 raft_consensus.cc:2258] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:42.881594 18816 tablet_bootstrap.cc:492] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: No bootstrap required, opened a new log
I20260810 04:50:42.881662 18816 ts_tablet_manager.cc:1397] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:42.881830 18816 raft_consensus.cc:348] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:42.881910 18816 raft_consensus.cc:374] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.881932 18816 raft_consensus.cc:729] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d98448a01241b2b64b8b7b9d7bc48b, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.881976 18816 consensus_queue.cc:260] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:42.882079 18816 ts_tablet_manager.cc:1428] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:42.882428 18847 ts_tablet_manager.cc:1905] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:42.882647 18845 ts_tablet_manager.cc:1905] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:42.884099 18847 ts_tablet_manager.cc:1918] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:50:42.884194 18847 log.cc:1196] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/d182df4cb2344588a4baeca9bbca055a
I20260810 04:50:42.884389 18845 ts_tablet_manager.cc:1918] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:50:42.884479 18845 log.cc:1196] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/d182df4cb2344588a4baeca9bbca055a
I20260810 04:50:42.884614 18810 tablet_bootstrap.cc:492] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: No bootstrap required, opened a new log
I20260810 04:50:42.884692 18810 ts_tablet_manager.cc:1397] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260810 04:50:42.884763 18845 ts_tablet_manager.cc:1939] T d182df4cb2344588a4baeca9bbca055a P c7d98448a01241b2b64b8b7b9d7bc48b: Deleting consensus metadata
I20260810 04:50:42.885129 18810 raft_consensus.cc:348] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:42.885236 18810 raft_consensus.cc:374] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:42.885262 18810 raft_consensus.cc:729] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48a0e68bd1a49e1bd37913c5de16b38, State: Initialized, Role: FOLLOWER
I20260810 04:50:42.885257 17976 catalog_manager.cc:4841] TS c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937): tablet d182df4cb2344588a4baeca9bbca055a (table test-table [id=5f997c092fb044199a3d879a58ec5082]) successfully deleted
I20260810 04:50:42.885324 18810 consensus_queue.cc:260] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:42.885485 18810 ts_tablet_manager.cc:1428] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:42.885823 18847 ts_tablet_manager.cc:1939] T d182df4cb2344588a4baeca9bbca055a P 253e66aa92b844d88e2630aa676d5568: Deleting consensus metadata
I20260810 04:50:42.886317 17976 catalog_manager.cc:4841] TS 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245): tablet d182df4cb2344588a4baeca9bbca055a (table test-table [id=5f997c092fb044199a3d879a58ec5082]) successfully deleted
W20260810 04:50:42.938279 18780 tablet.cc:2369] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:50:43.081310 18814 raft_consensus.cc:482] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:43.081463 18814 raft_consensus.cc:504] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.082026 18814 leader_election.cc:288] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907), c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937)
I20260810 04:50:43.085390 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.082326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:57857 (local address 127.15.239.193:34907)
0810 04:50:43.082389 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.082392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.082552 (+ 160us) server_negotiation.cc:407] Connection header received
0810 04:50:43.082625 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.082625 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.082635 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.082708 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:43.082956 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.083467 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.084632 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.085010 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.085068 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.085078 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.085261 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.085305 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:50:43.085417 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.082251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:40937 (local address 127.15.239.194:37177)
0810 04:50:43.082431 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.082450 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.082518 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.082725 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.082725 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.082728 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:43.082853 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.082855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.083546 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.083548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.084533 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.084536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.085144 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.085144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.085197 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.085201 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.085275 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.085315 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":31,"thread_start_us":115,"threads_started":1}
I20260810 04:50:43.085418 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.082347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:37177 (local address 127.15.239.195:40937)
0810 04:50:43.082413 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.082416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.082527 (+ 111us) server_negotiation.cc:407] Connection header received
0810 04:50:43.082610 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.082611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.082634 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.082707 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:43.082926 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.083461 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.084636 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.085036 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.085134 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.085143 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.085296 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.085344 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:50:43.085418 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.082259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34907 (local address 127.15.239.194:57857)
0810 04:50:43.082443 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.082455 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.082548 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.082718 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.082719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.082721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:43.082863 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.082864 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.083578 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.083580 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.084534 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.084537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.085096 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.085098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.085176 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.085181 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.085232 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.085297 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":51,"thread_start_us":85,"threads_started":1}
I20260810 04:50:43.085718 18706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b812bbb664494dbbe7635d431fcaf4" candidate_uuid: "253e66aa92b844d88e2630aa676d5568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" is_pre_election: true
I20260810 04:50:43.085913 18706 raft_consensus.cc:2454] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 253e66aa92b844d88e2630aa676d5568 in term 0.
I20260810 04:50:43.085913 18268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b812bbb664494dbbe7635d431fcaf4" candidate_uuid: "253e66aa92b844d88e2630aa676d5568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" is_pre_election: true
I20260810 04:50:43.086043 18268 raft_consensus.cc:2454] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 253e66aa92b844d88e2630aa676d5568 in term 0.
I20260810 04:50:43.086179 18371 leader_election.cc:302] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253e66aa92b844d88e2630aa676d5568, c7d98448a01241b2b64b8b7b9d7bc48b; no voters:
I20260810 04:50:43.086328 18814 raft_consensus.cc:2781] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:43.086373 18814 raft_consensus.cc:482] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:43.086395 18814 raft_consensus.cc:3037] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:43.087275 18814 raft_consensus.cc:504] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.087440 18814 leader_election.cc:288] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [CANDIDATE]: Term 1 election: Requested vote from peers e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907), c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937)
I20260810 04:50:43.087589 18268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b812bbb664494dbbe7635d431fcaf4" candidate_uuid: "253e66aa92b844d88e2630aa676d5568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48a0e68bd1a49e1bd37913c5de16b38"
I20260810 04:50:43.087630 18706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b812bbb664494dbbe7635d431fcaf4" candidate_uuid: "253e66aa92b844d88e2630aa676d5568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b"
I20260810 04:50:43.087680 18268 raft_consensus.cc:3037] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:43.087702 18706 raft_consensus.cc:3037] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:43.088656 18268 raft_consensus.cc:2454] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 253e66aa92b844d88e2630aa676d5568 in term 1.
I20260810 04:50:43.088714 18706 raft_consensus.cc:2454] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 253e66aa92b844d88e2630aa676d5568 in term 1.
I20260810 04:50:43.088858 18371 leader_election.cc:302] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253e66aa92b844d88e2630aa676d5568, c7d98448a01241b2b64b8b7b9d7bc48b; no voters:
I20260810 04:50:43.088955 18814 raft_consensus.cc:2781] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:43.089110 18814 raft_consensus.cc:686] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 1 LEADER]: Becoming Leader. State: Replica: 253e66aa92b844d88e2630aa676d5568, State: Running, Role: LEADER
I20260810 04:50:43.089238 18814 consensus_queue.cc:237] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.090137 17995 catalog_manager.cc:5495] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 reported cstate change: term changed from 0 to 1, leader changed from <none> to 253e66aa92b844d88e2630aa676d5568 (127.15.239.194). New cstate: current_term: 1 leader_uuid: "253e66aa92b844d88e2630aa676d5568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } health_report { overall_health: UNKNOWN } } }
Aug 10 04:50:43 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337441, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:43.141395 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.133119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37597 (local address 127.0.0.1:60628)
0810 04:50:43.133409 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.133430 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.133563 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.133773 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.133774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.134229 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:43.134298 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.134301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.135066 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.135068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.135822 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.135825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.136290 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.136291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.136345 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.137059 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:43.137065 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:43.138690 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:43.140287 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:43.140297 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:43.140300 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:43.140548 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:43.140745 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:43.140746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:43.140746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:43.140821 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:43.141049 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:43.141056 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:43.141104 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.141166 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.141275 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":158,"threads_started":1}
I20260810 04:50:43.141399 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.133230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60628 (local address 127.15.239.254:37597)
0810 04:50:43.133369 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.133372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.133534 (+ 162us) server_negotiation.cc:407] Connection header received
0810 04:50:43.133663 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.133664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.133679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.133739 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:43.134424 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.134983 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.135934 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.136195 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.136257 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.138780 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:43.138781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:43.138782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:43.138788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:43.140208 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:43.140628 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:43.140629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:43.140629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:43.140685 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:43.140878 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:43.140879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:43.140879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:43.140990 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:43.141043 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.141197 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.141324 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":95}
I20260810 04:50:43.144448 17995 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:60628:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 04:50:43.144784 17995 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:43.146607 18669 tablet_service.cc:1467] Processing CreateTablet for tablet 4113127b27af48029826d9d083c32b66 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52bd7044fa88477cb1981fe47ca5abf6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:50:43.146591 18446 tablet_service.cc:1467] Processing CreateTablet for tablet 4113127b27af48029826d9d083c32b66 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52bd7044fa88477cb1981fe47ca5abf6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:50:43.146816 18446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4113127b27af48029826d9d083c32b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:43.146824 18669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4113127b27af48029826d9d083c32b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:43.148713 18234 tablet_service.cc:1467] Processing CreateTablet for tablet 4113127b27af48029826d9d083c32b66 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=52bd7044fa88477cb1981fe47ca5abf6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:50:43.148878 18234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4113127b27af48029826d9d083c32b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:43.150189 18811 tablet_bootstrap.cc:492] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: Bootstrap starting.
I20260810 04:50:43.150215 18810 tablet_bootstrap.cc:492] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: Bootstrap starting.
I20260810 04:50:43.150661 18810 tablet_bootstrap.cc:654] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:43.150776 18811 tablet_bootstrap.cc:654] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:43.151386 18810 tablet_bootstrap.cc:492] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: No bootstrap required, opened a new log
I20260810 04:50:43.151436 18810 ts_tablet_manager.cc:1397] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:43.151576 18810 raft_consensus.cc:348] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.151646 18810 raft_consensus.cc:374] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:43.151660 18810 raft_consensus.cc:729] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48a0e68bd1a49e1bd37913c5de16b38, State: Initialized, Role: FOLLOWER
I20260810 04:50:43.151693 18810 consensus_queue.cc:260] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.151738 18811 tablet_bootstrap.cc:492] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: No bootstrap required, opened a new log
I20260810 04:50:43.151767 18810 ts_tablet_manager.cc:1428] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:43.151790 18811 ts_tablet_manager.cc:1397] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:50:43.151990 18811 raft_consensus.cc:348] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.152128 18811 raft_consensus.cc:374] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:43.152158 18811 raft_consensus.cc:729] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253e66aa92b844d88e2630aa676d5568, State: Initialized, Role: FOLLOWER
I20260810 04:50:43.152141 18816 tablet_bootstrap.cc:492] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: Bootstrap starting.
I20260810 04:50:43.152205 18811 consensus_queue.cc:260] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.152300 18811 ts_tablet_manager.cc:1428] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:43.152315 18817 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.152417 18817 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.152475 18814 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.152551 18814 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.152688 18816 tablet_bootstrap.cc:654] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:43.153399 18816 tablet_bootstrap.cc:492] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: No bootstrap required, opened a new log
I20260810 04:50:43.153450 18816 ts_tablet_manager.cc:1397] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:43.153606 18816 raft_consensus.cc:348] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.153672 18816 raft_consensus.cc:374] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:43.153687 18816 raft_consensus.cc:729] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d98448a01241b2b64b8b7b9d7bc48b, State: Initialized, Role: FOLLOWER
I20260810 04:50:43.153745 18816 consensus_queue.cc:260] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.153856 18816 ts_tablet_manager.cc:1428] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:43.153867 18820 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.154035 18820 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.294703 18817 raft_consensus.cc:482] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:43.294870 18817 raft_consensus.cc:504] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.295397 18817 leader_election.cc:288] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245), c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937)
I20260810 04:50:43.299676 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.295716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:59899 (local address 127.15.239.194:35245)
0810 04:50:43.295806 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.295809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.296003 (+ 194us) server_negotiation.cc:407] Connection header received
0810 04:50:43.296139 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.296141 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.296153 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.296191 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:43.296534 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.297464 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.298836 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.299234 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.299329 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.299345 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.299548 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.299604 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:50:43.299692 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.295642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:35245 (local address 127.15.239.193:59899)
0810 04:50:43.295911 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.295924 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.296008 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.296286 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.296287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.296289 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:43.296393 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.296396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.297566 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.297567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.298698 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.298702 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.299354 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.299356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.299448 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.299452 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.299522 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.299579 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":3,"thread_start_us":192,"threads_started":1}
I20260810 04:50:43.300043 18481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4113127b27af48029826d9d083c32b66" candidate_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253e66aa92b844d88e2630aa676d5568" is_pre_election: true
I20260810 04:50:43.300179 18481 raft_consensus.cc:2454] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e48a0e68bd1a49e1bd37913c5de16b38 in term 0.
I20260810 04:50:43.300338 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.296157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:48117 (local address 127.15.239.195:40937)
0810 04:50:43.296215 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.296217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.296258 (+ 41us) server_negotiation.cc:407] Connection header received
0810 04:50:43.296353 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.296354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.296366 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.296430 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:43.296602 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.297139 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.298802 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.299546 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.299638 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.299650 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.300165 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.300239 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:50:43.300477 18879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.296001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:40937 (local address 127.15.239.193:48117)
0810 04:50:43.296199 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.296210 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.296270 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.296454 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.296456 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.296458 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:43.296535 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.296537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.297240 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.297241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.298698 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.298702 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.299694 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.299696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.300008 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.300015 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.300144 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.300255 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":48,"thread_start_us":121,"threads_started":1}
I20260810 04:50:43.300442 18154 leader_election.cc:302] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253e66aa92b844d88e2630aa676d5568, e48a0e68bd1a49e1bd37913c5de16b38; no voters:
I20260810 04:50:43.300740 18817 raft_consensus.cc:2781] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:43.300788 18817 raft_consensus.cc:482] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:43.300824 18817 raft_consensus.cc:3037] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:43.300913 18706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4113127b27af48029826d9d083c32b66" candidate_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" is_pre_election: true
I20260810 04:50:43.301007 18706 raft_consensus.cc:2454] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e48a0e68bd1a49e1bd37913c5de16b38 in term 0.
I20260810 04:50:43.302150 18817 raft_consensus.cc:504] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.302326 18817 leader_election.cc:288] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [CANDIDATE]: Term 1 election: Requested vote from peers 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245), c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937)
I20260810 04:50:43.302601 18706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4113127b27af48029826d9d083c32b66" candidate_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b"
I20260810 04:50:43.302698 18706 raft_consensus.cc:3037] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:43.303506 18706 raft_consensus.cc:2454] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e48a0e68bd1a49e1bd37913c5de16b38 in term 1.
I20260810 04:50:43.303654 18481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4113127b27af48029826d9d083c32b66" candidate_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "253e66aa92b844d88e2630aa676d5568"
I20260810 04:50:43.303696 18154 leader_election.cc:302] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7d98448a01241b2b64b8b7b9d7bc48b, e48a0e68bd1a49e1bd37913c5de16b38; no voters:
I20260810 04:50:43.303750 18481 raft_consensus.cc:3037] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:43.303795 18817 raft_consensus.cc:2781] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:43.303983 18817 raft_consensus.cc:686] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 LEADER]: Becoming Leader. State: Replica: e48a0e68bd1a49e1bd37913c5de16b38, State: Running, Role: LEADER
I20260810 04:50:43.304102 18817 consensus_queue.cc:237] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } }
I20260810 04:50:43.304772 18481 raft_consensus.cc:2454] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e48a0e68bd1a49e1bd37913c5de16b38 in term 1.
I20260810 04:50:43.304863 18881 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: TxnStatusTablet state changed. Reason: New leader e48a0e68bd1a49e1bd37913c5de16b38. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.304968 18881 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:50:43.305078 17993 catalog_manager.cc:5495] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } health_report { overall_health: UNKNOWN } } }
I20260810 04:50:43.305213 18884 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 04:50:43.305339 18884 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 04:50:43.337287 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.334431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47964 (local address 127.15.239.193:34907)
0810 04:50:43.334514 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.334517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.334529 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:43.334634 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.334635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.334671 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.334737 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:43.334918 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.335477 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.336401 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.336618 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.336697 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.336893 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.337023 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.337116 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.337160 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.337187 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:50:43.337296 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.334345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34907 (local address 127.0.0.1:47964)
0810 04:50:43.334435 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.334450 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.334528 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.334761 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.334763 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.334764 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:43.334842 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.334845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.335575 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.335577 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.336298 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.336301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.336694 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.336696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.336766 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.336784 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.337096 (+ 312us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.337108 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.337157 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.337220 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 04:50:43.339032 18481 raft_consensus.cc:1261] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Refusing update from remote peer e48a0e68bd1a49e1bd37913c5de16b38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:43.339100 18706 raft_consensus.cc:1261] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Refusing update from remote peer e48a0e68bd1a49e1bd37913c5de16b38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:43.339483 18881 consensus_queue.cc:1035] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:43.339655 18817 consensus_queue.cc:1035] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:43.340458 18814 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: TxnStatusTablet state changed. Reason: New leader e48a0e68bd1a49e1bd37913c5de16b38. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.340584 18814 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.341006 18820 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: TxnStatusTablet state changed. Reason: New leader e48a0e68bd1a49e1bd37913c5de16b38. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.341117 18820 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.341585 18817 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.341688 18817 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:50:43.342270 18814 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.342362 18814 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P 253e66aa92b844d88e2630aa676d5568: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.343154 18881 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.343297 18881 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P e48a0e68bd1a49e1bd37913c5de16b38: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:50:43.343441 18829 mvcc.cc:205] Tried to move back new op lower bound from 7316838167913717760 to 7316838167774490624. Current Snapshot: MvccSnapshot[applied={T|T < 7316838167913717760}]
I20260810 04:50:43.343564 18820 tablet_replica.cc:439] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 } } peers { permanent_uuid: "253e66aa92b844d88e2630aa676d5568" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35245 } } peers { permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 } } }
I20260810 04:50:43.343653 18820 tablet_replica.cc:442] T 4113127b27af48029826d9d083c32b66 P c7d98448a01241b2b64b8b7b9d7bc48b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:43.347546 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.344572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50952 (local address 127.15.239.194:35245)
0810 04:50:43.344615 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.344617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.344626 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:50:43.344707 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.344707 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.344737 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.344828 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:43.344983 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.345760 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.346601 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.346922 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.347006 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.347133 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.347294 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.347371 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.347390 (+ 19us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.347415 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:50:43.353796 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.350845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:43755 (local address 127.15.239.193:34907)
0810 04:50:43.350935 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.350937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.350969 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:50:43.351055 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.351057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.351069 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.351126 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:43.351303 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.351790 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.353000 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.353209 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.353300 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.353512 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.353554 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.353612 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.353684 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.353707 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 04:50:43.353837 18897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.350661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34907 (local address 127.15.239.194:43755)
0810 04:50:43.350895 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.350910 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.350990 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.351129 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.351130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.351132 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:43.351215 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.351218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.351905 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.351906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.352900 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.352903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.353304 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.353305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.353391 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.353407 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.353627 (+ 220us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.353630 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.353680 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.353732 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":107,"threads_started":1}
I20260810 04:50:43.356825 18706 raft_consensus.cc:1261] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Refusing update from remote peer 253e66aa92b844d88e2630aa676d5568: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:43.356930 18268 raft_consensus.cc:1261] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Refusing update from remote peer 253e66aa92b844d88e2630aa676d5568: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:43.357160 18814 consensus_queue.cc:1035] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7d98448a01241b2b64b8b7b9d7bc48b" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 40937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:43.357336 18855 consensus_queue.cc:1035] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e48a0e68bd1a49e1bd37913c5de16b38" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:43.367080 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.364172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:57087 (local address 127.15.239.194:35245)
0810 04:50:43.364293 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.364296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.364305 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:50:43.364335 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.364336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.364347 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.364402 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:43.364529 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.365320 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.366202 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.366515 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.366596 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.366797 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.366837 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.366884 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.366948 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.366970 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260810 04:50:43.367147 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.363959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:35245 (local address 127.15.239.193:57087)
0810 04:50:43.364225 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:43.364245 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:43.364296 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:43.364411 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:43.364411 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:43.364412 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:43.364485 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.364487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.365418 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.365418 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.366117 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:43.366120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.366595 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.366596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:43.366678 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.366696 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:43.366899 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:43.366901 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:50:43.366946 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:50:43.367009 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":154,"threads_started":1}
I20260810 04:50:43.377072 17995 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:43.377255 17995 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:43.378116 17995 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7d713133ea14f8fbc2dc37c84d3cea5: Sending DeleteTablet for 3 replicas of tablet 03b812bbb664494dbbe7635d431fcaf4
I20260810 04:50:43.378424 18446 tablet_service.cc:1514] Processing DeleteTablet for tablet 03b812bbb664494dbbe7635d431fcaf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:43 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:50946
I20260810 04:50:43.378469 18669 tablet_service.cc:1514] Processing DeleteTablet for tablet 03b812bbb664494dbbe7635d431fcaf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:43 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:47328
I20260810 04:50:43.378548 18847 tablet_replica.cc:330] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: stopping tablet replica
I20260810 04:50:43.378610 18847 raft_consensus.cc:2229] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:50:43.378609 18234 tablet_service.cc:1514] Processing DeleteTablet for tablet 03b812bbb664494dbbe7635d431fcaf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:43 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:47960
I20260810 04:50:43.378706 18847 raft_consensus.cc:2258] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:43.378793 18845 tablet_replica.cc:330] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: stopping tablet replica
I20260810 04:50:43.378890 18845 raft_consensus.cc:2229] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:43.378931 18845 raft_consensus.cc:2258] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:43.379505 18847 ts_tablet_manager.cc:1905] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:43.381454 18847 ts_tablet_manager.cc:1918] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:43.381520 18847 log.cc:1196] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/03b812bbb664494dbbe7635d431fcaf4
I20260810 04:50:43.381877 18845 ts_tablet_manager.cc:1905] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:43.383638 18845 ts_tablet_manager.cc:1918] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:43.383706 18845 log.cc:1196] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/03b812bbb664494dbbe7635d431fcaf4
I20260810 04:50:43.383931 18845 ts_tablet_manager.cc:1939] T 03b812bbb664494dbbe7635d431fcaf4 P c7d98448a01241b2b64b8b7b9d7bc48b: Deleting consensus metadata
I20260810 04:50:43.384181 18847 ts_tablet_manager.cc:1939] T 03b812bbb664494dbbe7635d431fcaf4 P 253e66aa92b844d88e2630aa676d5568: Deleting consensus metadata
I20260810 04:50:43.384357 17976 catalog_manager.cc:4841] TS c7d98448a01241b2b64b8b7b9d7bc48b (127.15.239.195:40937): tablet 03b812bbb664494dbbe7635d431fcaf4 (table test-table [id=6bba3214f0734d7c8c4adb82f2188ce9]) successfully deleted
I20260810 04:50:43.384586 17976 catalog_manager.cc:4841] TS 253e66aa92b844d88e2630aa676d5568 (127.15.239.194:35245): tablet 03b812bbb664494dbbe7635d431fcaf4 (table test-table [id=6bba3214f0734d7c8c4adb82f2188ce9]) successfully deleted
Aug 10 04:50:43 dist-test-slave-kvfs krb5kdc[17920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337442, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:50:43.391295 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.379820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47978 (local address 127.15.239.193:34907)
0810 04:50:43.379887 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.379890 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.380076 (+ 186us) server_negotiation.cc:407] Connection header received
0810 04:50:43.380164 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.380165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.380177 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.380224 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:43.380881 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.381412 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.382707 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.383053 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.383099 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.387395 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:43.387405 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:43.387406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:43.387416 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:43.389796 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:43.390258 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:43.390262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:43.390263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:43.390347 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:43.390589 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:43.390590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:43.390590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:43.390805 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:43.390992 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.391073 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.391180 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 04:50:43.391901 18331 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47978
I20260810 04:50:43.396152 18906 tablet_replica.cc:330] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: stopping tablet replica
I20260810 04:50:43.396256 18906 raft_consensus.cc:2229] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:43.396317 18906 raft_consensus.cc:2258] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:43.396706 18906 ts_tablet_manager.cc:1905] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:43.398864 18906 ts_tablet_manager.cc:1918] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:43.399003 18906 log.cc:1196] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/03b812bbb664494dbbe7635d431fcaf4
I20260810 04:50:43.399360 18906 ts_tablet_manager.cc:1939] T 03b812bbb664494dbbe7635d431fcaf4 P e48a0e68bd1a49e1bd37913c5de16b38: Deleting consensus metadata
I20260810 04:50:43.399793 17978 catalog_manager.cc:4841] TS e48a0e68bd1a49e1bd37913c5de16b38 (127.15.239.193:34907): tablet 03b812bbb664494dbbe7635d431fcaf4 (table test-table [id=6bba3214f0734d7c8c4adb82f2188ce9]) successfully deleted
I20260810 04:50:43.404663 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:43.393238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60640 (local address 127.15.239.254:37597)
0810 04:50:43.393297 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:43.393299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:43.396259 (+ 2960us) server_negotiation.cc:407] Connection header received
0810 04:50:43.396385 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:43.396387 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:43.396404 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:43.396441 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:43.397254 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.398091 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.399173 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:43.399464 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:43.399519 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:43.401387 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:43.401389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:43.401389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:43.401398 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:43.403184 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:43.403626 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:43.403627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:43.403628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:43.403699 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:43.403941 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:43.403942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:43.403942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:43.404182 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:43.404301 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:43.404453 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 04:50:43.404551 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 04:50:43.404932 17995 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60640
I20260810 04:50:43.405834 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18131
I20260810 04:50:43.424577 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18350
I20260810 04:50:43.441293 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18568
I20260810 04:50:43.466514 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17942
2026-08-10T04:50:43Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3033 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:43 dist-test-slave-kvfs krb5kdc[18916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:43 dist-test-slave-kvfs krb5kdc[18916](info): set up 2 sockets
Aug 10 04:50:43 dist-test-slave-kvfs krb5kdc[18916](info): commencing operation
krb5kdc: starting...
W20260810 04:50:44.780941 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:44 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:44.933550 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42925
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:45.052671 18938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:45.052944 18938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:45.052970 18938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:45.054154 18938 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:45.054198 18938 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 04:50:45.054212 18938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:45.054226 18938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:45.054239 18938 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:45.054251 18938 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:45.055826 18938 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42925
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:45.056149 18938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:45.056396 18938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:45.062115 18950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:45.062176 18946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:45.062115 18948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:45.062381 18938 server_base.cc:1034] running on GCE node
I20260810 04:50:45.062678 18938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:45.062989 18938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:45.064174 18938 hybrid_clock.cc:648] HybridClock initialized: now 1786337445064151 us; error 41 us; skew 500 ppm
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:45.067057 18938 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:45.067539 18938 webserver.cc:460] Webserver started at http://127.15.239.254:45319/ using document root <none> and password file <none>
I20260810 04:50:45.067791 18938 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:45.067838 18938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:45.067945 18938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:45.069363 18938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "357abae7d9db44aba098e692de9153c3"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "6a22b34945a0b1582c15021e15e45877"
server_key_iv: "0462613c33221e4b1c46ff5974440e89"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.069723 18938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "357abae7d9db44aba098e692de9153c3"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "6a22b34945a0b1582c15021e15e45877"
server_key_iv: "0462613c33221e4b1c46ff5974440e89"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.071184 18938 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:50:45.071945 18961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.072199 18938 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:45.072291 18938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "357abae7d9db44aba098e692de9153c3"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "6a22b34945a0b1582c15021e15e45877"
server_key_iv: "0462613c33221e4b1c46ff5974440e89"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.072356 18938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:45.100387 18938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:45.102805 18938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:45.102952 18938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:45.108525 18938 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:42925
I20260810 04:50:45.108713 19051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:42925 every 8 connection(s)
I20260810 04:50:45.109102 18938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:45.109992 19052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.112850 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18938
I20260810 04:50:45.112938 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:45.113065 19052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Bootstrap starting.
I20260810 04:50:45.113155 16319 external_mini_cluster.cc:1428] Setting key 400899636f8a9b72063f28343fce725d
I20260810 04:50:45.114058 19052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.114441 19052 log.cc:824] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:45.115391 19052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: No bootstrap required, opened a new log
I20260810 04:50:45.118085 19052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "357abae7d9db44aba098e692de9153c3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42925 } }
I20260810 04:50:45.118259 19052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.118286 19052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357abae7d9db44aba098e692de9153c3, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.118446 19052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "357abae7d9db44aba098e692de9153c3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42925 } }
I20260810 04:50:45.118548 19052 raft_consensus.cc:388] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:45.118577 19052 raft_consensus.cc:482] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:45.118652 19052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:45.119333 19052 raft_consensus.cc:504] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "357abae7d9db44aba098e692de9153c3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42925 } }
I20260810 04:50:45.119483 19052 leader_election.cc:302] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 357abae7d9db44aba098e692de9153c3; no voters:
I20260810 04:50:45.119827 19052 leader_election.cc:288] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:45.119869 19059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:45.120229 19052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:45.121315 19059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [term 1 LEADER]: Becoming Leader. State: Replica: 357abae7d9db44aba098e692de9153c3, State: Running, Role: LEADER
I20260810 04:50:45.121448 19059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "357abae7d9db44aba098e692de9153c3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42925 } }
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:45.121939 19060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "357abae7d9db44aba098e692de9153c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "357abae7d9db44aba098e692de9153c3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42925 } } }
I20260810 04:50:45.122066 19060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:45.121960 19062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 357abae7d9db44aba098e692de9153c3. Latest consensus state: current_term: 1 leader_uuid: "357abae7d9db44aba098e692de9153c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "357abae7d9db44aba098e692de9153c3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42925 } } }
I20260810 04:50:45.122198 19062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3 [sys.catalog]: This master's current role is: LEADER
W20260810 04:50:45.123652 19082 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:50:45.123718 19082 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:50:45.123766 19073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:45.123941 19073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:45.125924 19073 catalog_manager.cc:1347] Generated new cluster ID: 2ab3c4ab8e1147cba82a9d9b383a371b
I20260810 04:50:45.125986 19073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:50:45.126830 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.113856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57820 (local address 127.15.239.254:42925)
0810 04:50:45.114100 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.114113 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.114155 (+ 42us) server_negotiation.cc:407] Connection header received
0810 04:50:45.114885 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.114896 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.114965 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.115166 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.115935 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.117565 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.118661 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.119194 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.119369 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.122656 (+ 3287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.122662 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.122662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.122680 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.124866 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.125326 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.125330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.125331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.125455 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.125724 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.125725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.125726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.126082 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.126275 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.126426 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.126587 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":109,"threads_started":1}
I20260810 04:50:45.140126 19073 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:45.140739 19073 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:45.148320 19073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Generated new TSK 0
I20260810 04:50:45.148545 19073 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:50:45.188688 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42925
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:45.293387 19090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:45.293682 19090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:45.293728 19090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:45.294973 19090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:45.295044 19090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:45.295079 19090 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 04:50:45.295109 19090 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:50:45.295143 19090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:45.296886 19090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:42925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:45.297211 19090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:45.297497 19090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:45.303601 19106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:45.303574 19103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:45.303824 19090 server_base.cc:1034] running on GCE node
W20260810 04:50:45.303632 19104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:45.304211 19090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:45.304575 19090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:45.305774 19090 hybrid_clock.cc:648] HybridClock initialized: now 1786337445305748 us; error 45 us; skew 500 ppm
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:45.308936 19090 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:45.309491 19090 webserver.cc:460] Webserver started at http://127.15.239.193:41871/ using document root <none> and password file <none>
I20260810 04:50:45.309785 19090 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:45.309859 19090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:45.310037 19090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:45.311293 19090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "50a492015a264b51bc0b82b177877ea8"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "f101e2cbf7760c2df5535773e76eeb63"
server_key_iv: "f2e3243ba1c1df2e0b1a8d4bf9695c96"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.311852 19090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "50a492015a264b51bc0b82b177877ea8"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "f101e2cbf7760c2df5535773e76eeb63"
server_key_iv: "f2e3243ba1c1df2e0b1a8d4bf9695c96"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.313593 19090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:50:45.314483 19116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.314692 19090 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:45.314821 19090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "50a492015a264b51bc0b82b177877ea8"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "f101e2cbf7760c2df5535773e76eeb63"
server_key_iv: "f2e3243ba1c1df2e0b1a8d4bf9695c96"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.314913 19090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:45.332105 19090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:45.334983 19090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:45.335184 19090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:45.337227 19090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:45.337285 19090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.337337 19090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:45.337361 19090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:45.346592 19090 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:39285
I20260810 04:50:45.346645 19284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:39285 every 8 connection(s)
I20260810 04:50:45.347055 19090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:45.348170 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 19090
I20260810 04:50:45.348294 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:45.348500 16319 external_mini_cluster.cc:1428] Setting key db2bc8e1dd5c2607df797d59cd44c149
I20260810 04:50:45.349856 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.338183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:36537 (local address 127.15.239.254:42925)
0810 04:50:45.338273 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.338276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.338291 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:50:45.338898 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.338899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.338925 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.338986 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.339952 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.340626 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.341859 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.342310 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.342403 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.345966 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.345968 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.345968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.345979 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.347960 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.348553 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.348555 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.348555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.348636 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.348939 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.348940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.348940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.349091 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.349162 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.349592 (+ 430us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.349716 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 04:50:45.349896 19137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.337762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.15.239.193:36537)
0810 04:50:45.337979 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.338049 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.338737 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.339088 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.339092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.339500 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.339830 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.339837 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.340739 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.340740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.341766 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.341770 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.342451 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.342453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.342623 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.343301 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.343311 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.345858 (+ 2547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.348112 (+ 2254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.348120 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.348123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.348458 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.348727 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.348728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.348729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.348894 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.349183 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.349191 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.349437 (+ 246us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.349544 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.349698 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260810 04:50:45.350524 19285 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42925
I20260810 04:50:45.350633 19285 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:45.350862 19285 heartbeater.cc:511] Master 127.15.239.254:42925 requested a full tablet report, sending...
I20260810 04:50:45.351508 18984 ts_manager.cc:194] Registered new tserver with Master: 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285)
I20260810 04:50:45.352442 18984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:36537
I20260810 04:50:45.359241 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.352098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:45055 (local address 127.15.239.254:42925)
0810 04:50:45.352657 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.352659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.352668 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:50:45.352689 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.352689 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.352701 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.352756 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.353216 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.353898 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.354973 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.355182 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.355240 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.356486 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.356487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.356487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.356494 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.358032 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.358458 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.358459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.358460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.358516 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.358749 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.358750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.358750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.358856 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.358904 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.359085 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.359160 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538}
I20260810 04:50:45.359325 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.351798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.15.239.193:45055)
0810 04:50:45.352129 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.352142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.352206 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.352764 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.352765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.353043 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.353123 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.353125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.354008 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.354010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.354866 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.354869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.355261 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.355262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.355353 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.355863 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.355870 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.356381 (+ 511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.358124 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.358125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.358126 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.358378 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.358587 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.358588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.358589 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.358675 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.358919 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.358921 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.358978 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.359055 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.359194 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:50:45.383813 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42925
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:45.482836 19300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:45.483115 19300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:45.483144 19300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:45.484448 19300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:45.484499 19300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:45.484521 19300 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 04:50:45.484534 19300 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:50:45.484551 19300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:50:45.486155 19300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:42925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:45.486413 19300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:45.486652 19300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:45.493064 19311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:45.493067 19313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:45.493064 19308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:45.493438 19300 server_base.cc:1034] running on GCE node
I20260810 04:50:45.493728 19300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:45.494014 19300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:45.495183 19300 hybrid_clock.cc:648] HybridClock initialized: now 1786337445495175 us; error 40 us; skew 500 ppm
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:45.498620 19300 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:50:45.499375 19300 webserver.cc:460] Webserver started at http://127.15.239.194:37929/ using document root <none> and password file <none>
I20260810 04:50:45.499719 19300 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:45.499806 19300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:45.500007 19300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:45.501554 19300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "b4a9239d4f444937bf592e11523ab935"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "9d28bce6e60c0a8c051be7dd15188d7c"
server_key_iv: "7bc5a6363f92c183fb8868702b8255ef"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.501938 19300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "b4a9239d4f444937bf592e11523ab935"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "9d28bce6e60c0a8c051be7dd15188d7c"
server_key_iv: "7bc5a6363f92c183fb8868702b8255ef"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.503561 19300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:50:45.504691 19324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.504993 19300 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:50:45.505101 19300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "b4a9239d4f444937bf592e11523ab935"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "9d28bce6e60c0a8c051be7dd15188d7c"
server_key_iv: "7bc5a6363f92c183fb8868702b8255ef"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.505177 19300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:45.516281 19300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:45.518860 19300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:45.519011 19300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:45.519757 19300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:45.519807 19300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.519834 19300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:45.519847 19300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:45.528761 19300 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:33263
I20260810 04:50:45.529161 19486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:33263 every 8 connection(s)
I20260810 04:50:45.529261 19300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:50:45.531821 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 19300
I20260810 04:50:45.531948 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:50:45.531983 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.520334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:54967 (local address 127.15.239.254:42925)
0810 04:50:45.520426 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.520428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.520701 (+ 273us) server_negotiation.cc:407] Connection header received
0810 04:50:45.521394 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.521396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.521411 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.521494 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.522513 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.523448 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.525397 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.525650 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.525754 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.528477 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.528479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.528479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.528497 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.530202 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.530800 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.530802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.530802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.530870 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.531160 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.531161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.531162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.531325 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.531404 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.531708 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.531834 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:50:45.532173 19334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.520315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.15.239.194:54967)
0810 04:50:45.520533 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.520583 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.521242 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.521602 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.521606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.522009 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.522412 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.522420 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.523573 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.523574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.525281 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.525286 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.525789 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.525791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.525939 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.526625 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.526635 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.528355 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.530348 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.530357 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.530361 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.530713 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.530935 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.530936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.530936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.531070 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.531399 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.531405 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.531557 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.531652 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.531813 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":130,"threads_started":1}
I20260810 04:50:45.532270 16319 external_mini_cluster.cc:1428] Setting key b70296cccc2620a62f31cdf73f32a756
I20260810 04:50:45.532801 19487 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42925
I20260810 04:50:45.532898 19487 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:45.533164 19487 heartbeater.cc:511] Master 127.15.239.254:42925 requested a full tablet report, sending...
I20260810 04:50:45.533595 18985 ts_manager.cc:194] Registered new tserver with Master: b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:45.534171 18985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:54967
I20260810 04:50:45.541565 19500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.534126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.15.239.194:59441)
0810 04:50:45.534378 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.534394 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.534472 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.534637 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.534637 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.534934 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.535023 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.535026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.535749 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.535750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.536374 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.536376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.536747 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.536748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.536834 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.537436 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.537442 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.537811 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.540140 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.540141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.540142 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.540369 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.540658 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.540658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.540659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.540736 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.541241 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.541242 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.541296 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.541369 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.541477 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":101,"threads_started":1}
I20260810 04:50:45.541714 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.534197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:59441 (local address 127.15.239.254:42925)
0810 04:50:45.534242 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.534244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.534458 (+ 214us) server_negotiation.cc:407] Connection header received
0810 04:50:45.534545 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.534546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.534556 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.534613 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.535143 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.535636 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.536467 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.536670 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.536748 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.537921 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.537923 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.537924 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.537933 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.539995 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.540460 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.540471 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.540471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.540553 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.540833 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.540834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.540835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.541135 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.541229 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.541434 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.541553 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:50:45.571218 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42925
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:45.669530 19503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:45.669772 19503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:45.669798 19503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:45.670986 19503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:45.671029 19503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:45.671051 19503 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 04:50:45.671087 19503 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:50:45.671120 19503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:50:45.672704 19503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:42925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:45.672991 19503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:45.673262 19503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:45.679280 19512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:45.679275 19510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:45.679508 19503 server_base.cc:1034] running on GCE node
W20260810 04:50:45.679282 19509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:45.679833 19503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:45.680176 19503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:45.681445 19503 hybrid_clock.cc:648] HybridClock initialized: now 1786337445681438 us; error 42 us; skew 500 ppm
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:45.684399 19503 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:50:45.684973 19503 webserver.cc:460] Webserver started at http://127.15.239.195:37861/ using document root <none> and password file <none>
I20260810 04:50:45.685263 19503 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:45.685338 19503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:45.685504 19503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:45.686789 19503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "abd62211ab0a476ea63318d4584971db"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "2424b5fc314c796fe01cddba2c40c005"
server_key_iv: "ca90206138cc7f0e7dfa0d5033cf72f4"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.687222 19503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "abd62211ab0a476ea63318d4584971db"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "2424b5fc314c796fe01cddba2c40c005"
server_key_iv: "ca90206138cc7f0e7dfa0d5033cf72f4"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.688956 19503 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:50:45.689857 19524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.690065 19503 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:45.690181 19503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "abd62211ab0a476ea63318d4584971db"
format_stamp: "Formatted at 2026-08-10 04:50:45 on dist-test-slave-kvfs"
server_key: "2424b5fc314c796fe01cddba2c40c005"
server_key_iv: "ca90206138cc7f0e7dfa0d5033cf72f4"
server_key_version: "encryptionkey@0"
I20260810 04:50:45.690266 19503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:45.703548 19503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:45.706105 19503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:45.706338 19503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:45.707052 19503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:45.707129 19503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.707186 19503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:45.707213 19503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:45.716233 19503 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:35431
I20260810 04:50:45.716640 19713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:35431 every 8 connection(s)
I20260810 04:50:45.716790 19503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:50:45.719455 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.707581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.15.239.195:60923)
0810 04:50:45.707780 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.707828 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.708563 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.708936 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.708941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.709352 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.709724 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.709731 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.711030 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.711031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.712500 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.712504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.713145 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.713146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.713309 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.714033 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.714042 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.715917 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.718004 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.718009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.718011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.718316 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.718506 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.718507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.718507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.718614 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.718859 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.718865 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.719028 (+ 163us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.719124 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.719268 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":119,"threads_started":1}
I20260810 04:50:45.719451 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.707615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:60923 (local address 127.15.239.254:42925)
0810 04:50:45.707709 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.707713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.707944 (+ 231us) server_negotiation.cc:407] Connection header received
0810 04:50:45.708697 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.708700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.708718 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.708822 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.709850 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.710909 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.712609 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.713028 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.713128 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.716015 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.716037 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.716038 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.716046 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.717923 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.718374 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.718375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.718376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.718442 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.718657 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.718657 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.718657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.718772 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.718861 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.719194 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.719276 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 04:50:45.719560 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 19503
I20260810 04:50:45.719647 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:50:45.719898 16319 external_mini_cluster.cc:1428] Setting key 0e0e9fd61b665345ca36f790066aea2f
I20260810 04:50:45.720258 19715 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42925
I20260810 04:50:45.720362 19715 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:45.720613 19715 heartbeater.cc:511] Master 127.15.239.254:42925 requested a full tablet report, sending...
I20260810 04:50:45.721107 18984 ts_manager.cc:194] Registered new tserver with Master: abd62211ab0a476ea63318d4584971db (127.15.239.195:35431)
I20260810 04:50:45.721587 18984 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:60923
I20260810 04:50:45.727082 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.721446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:40507 (local address 127.15.239.254:42925)
0810 04:50:45.721489 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.721491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.721676 (+ 185us) server_negotiation.cc:407] Connection header received
0810 04:50:45.721842 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.721843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.721855 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.721909 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.722302 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.722865 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.723595 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.723805 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.723881 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.724796 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.724798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.724798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.724805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.725928 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.726278 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.726280 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.726280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.726344 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.726549 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.726549 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.726550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.726665 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.726743 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.726901 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.726982 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:50:45.727093 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.721432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.15.239.195:40507)
0810 04:50:45.721577 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.721588 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.721774 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.721913 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.721914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.722151 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.722223 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.722225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.722990 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.722991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.723509 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.723510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.723881 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.723882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.723981 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.724416 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.724421 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.724706 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.726027 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.726027 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.726028 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.726203 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.726413 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.726414 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.726414 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.726478 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.726734 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.726735 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.726782 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.726871 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.726982 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260810 04:50:45.732121 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:45.762070 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.753975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57828 (local address 127.15.239.254:42925)
0810 04:50:45.754057 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.754060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.754075 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:50:45.754109 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.754111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.754121 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.754193 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.754851 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.755433 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.756324 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.756538 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.756617 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.759163 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.759164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.759165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.759182 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.760737 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.761162 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.761164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.761164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.761232 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.761451 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.761452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.761453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.761585 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.761702 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.761844 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.761940 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:50:45.763904 18984 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:50:45.765995 18984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:45.773453 19738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.768963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39285 (local address 127.0.0.1:54588)
0810 04:50:45.769158 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.769210 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.769290 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.769903 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.769906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.769908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.770012 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.770014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.771170 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.771171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.772319 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.772323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.773115 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.773116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.773197 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.773213 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.773293 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.773364 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":71,"threads_started":1}
I20260810 04:50:45.773499 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.769434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54588 (local address 127.15.239.193:39285)
0810 04:50:45.769667 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.769674 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.769687 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:50:45.769740 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.769743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.769761 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.769893 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.770108 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.771078 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.772419 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.773031 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.773112 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.773185 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.773325 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.773378 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":151,"threads_started":1}
I20260810 04:50:45.774138 19741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.769201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:33263 (local address 127.0.0.1:32976)
0810 04:50:45.769357 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.769367 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.769414 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.770240 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.770241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.770243 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.770299 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.770301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.771661 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.771662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.772898 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.772899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.773913 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.773914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.773978 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.773983 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.774015 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.774063 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":3,"thread_start_us":114,"threads_started":1}
I20260810 04:50:45.774288 19737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.768974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.0.0.1:54922)
0810 04:50:45.769161 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.769217 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.769289 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.770403 (+ 1114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.770405 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.770407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.770454 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.770456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.771758 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.771759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.772895 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.772898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.774015 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.774017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.774088 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.774094 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.774145 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.774191 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":121,"threads_started":1}
I20260810 04:50:45.774506 19746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.769837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32976 (local address 127.15.239.194:33263)
0810 04:50:45.770057 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.770063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.770075 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:45.770119 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.770121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.770137 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.770245 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.770378 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.771558 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.773009 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.773802 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.774270 (+ 468us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.774334 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.774362 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.774403 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":105,"threads_started":1}
I20260810 04:50:45.774555 19739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.769116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54922 (local address 127.15.239.195:35431)
0810 04:50:45.770134 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.770138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.770150 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:45.770211 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.770213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.770230 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.770316 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.770563 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.771669 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.772999 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.773835 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.773914 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.773977 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.774404 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.774454 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":970,"thread_start_us":104,"threads_started":1}
I20260810 04:50:45.774806 19188 tablet_service.cc:1467] Processing CreateTablet for tablet 05b4114288f5408ba8be56cc8b56cfbf (DEFAULT_TABLE table=test-table [id=83ee5dc711214c1ca97e682e3e2a0710]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:45.775279 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05b4114288f5408ba8be56cc8b56cfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.775242 19393 tablet_service.cc:1467] Processing CreateTablet for tablet 05b4114288f5408ba8be56cc8b56cfbf (DEFAULT_TABLE table=test-table [id=83ee5dc711214c1ca97e682e3e2a0710]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:45.775234 19607 tablet_service.cc:1467] Processing CreateTablet for tablet 05b4114288f5408ba8be56cc8b56cfbf (DEFAULT_TABLE table=test-table [id=83ee5dc711214c1ca97e682e3e2a0710]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:45.775663 19607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05b4114288f5408ba8be56cc8b56cfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.775663 19393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05b4114288f5408ba8be56cc8b56cfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.778982 19747 tablet_bootstrap.cc:492] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Bootstrap starting.
I20260810 04:50:45.779675 19748 tablet_bootstrap.cc:492] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Bootstrap starting.
I20260810 04:50:45.779785 19757 tablet_bootstrap.cc:492] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Bootstrap starting.
I20260810 04:50:45.780131 19747 tablet_bootstrap.cc:654] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.780546 19757 tablet_bootstrap.cc:654] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.780555 19747 log.cc:824] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:45.780764 19748 tablet_bootstrap.cc:654] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.780970 19757 log.cc:824] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:45.781144 19748 log.cc:824] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:45.781484 19747 tablet_bootstrap.cc:492] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: No bootstrap required, opened a new log
I20260810 04:50:45.781571 19747 ts_tablet_manager.cc:1397] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:50:45.781912 19757 tablet_bootstrap.cc:492] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: No bootstrap required, opened a new log
I20260810 04:50:45.781934 19748 tablet_bootstrap.cc:492] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: No bootstrap required, opened a new log
I20260810 04:50:45.781996 19748 ts_tablet_manager.cc:1397] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:50:45.781991 19757 ts_tablet_manager.cc:1397] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:50:45.783464 19747 raft_consensus.cc:348] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.783643 19747 raft_consensus.cc:374] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.783689 19747 raft_consensus.cc:729] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a492015a264b51bc0b82b177877ea8, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.783820 19747 consensus_queue.cc:260] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.784193 19285 heartbeater.cc:503] Master 127.15.239.254:42925 was elected leader, sending a full tablet report...
I20260810 04:50:45.784178 19757 raft_consensus.cc:348] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.784353 19757 raft_consensus.cc:374] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.784274 19748 raft_consensus.cc:348] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.784394 19757 raft_consensus.cc:729] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a9239d4f444937bf592e11523ab935, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.784405 19748 raft_consensus.cc:374] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.784441 19748 raft_consensus.cc:729] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd62211ab0a476ea63318d4584971db, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.784528 19757 consensus_queue.cc:260] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.784543 19748 consensus_queue.cc:260] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.784180 19747 ts_tablet_manager.cc:1428] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:50:45.784814 19757 ts_tablet_manager.cc:1428] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:50:45.784955 19487 heartbeater.cc:503] Master 127.15.239.254:42925 was elected leader, sending a full tablet report...
I20260810 04:50:45.785277 19748 ts_tablet_manager.cc:1428] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:50:45.785315 19715 heartbeater.cc:503] Master 127.15.239.254:42925 was elected leader, sending a full tablet report...
W20260810 04:50:45.848188 19286 tablet.cc:2369] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:50:45.853039 19767 raft_consensus.cc:482] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:45.853201 19767 raft_consensus.cc:504] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.853806 19767 leader_election.cc:288] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:45.855378 19764 raft_consensus.cc:482] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:45.855540 19764 raft_consensus.cc:504] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.856519 19764 leader_election.cc:288] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263), abd62211ab0a476ea63318d4584971db (127.15.239.195:35431)
I20260810 04:50:45.857956 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.854119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39285 (local address 127.15.239.195:59911)
0810 04:50:45.854193 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.854208 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.854321 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.854618 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.854620 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.854623 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.854731 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.854734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.855691 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.855692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.857050 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.857053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.857657 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.857658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.857754 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.857758 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.857819 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.857866 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":5}
I20260810 04:50:45.858238 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.854257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:59911 (local address 127.15.239.193:39285)
0810 04:50:45.854443 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.854445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.854455 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:50:45.854495 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.854497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.854509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.854583 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.854825 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.855590 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.857135 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.857568 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.857662 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.857674 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.858122 (+ 448us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.858170 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260810 04:50:45.858529 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b4114288f5408ba8be56cc8b56cfbf" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8" is_pre_election: true
I20260810 04:50:45.858671 19217 raft_consensus.cc:2454] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 0.
I20260810 04:50:45.858753 19746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.854447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:55731 (local address 127.15.239.194:33263)
0810 04:50:45.854505 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.854507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.854614 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:50:45.854651 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.854653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.854664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.854734 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.854985 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.855722 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.857752 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.858308 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.858363 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.858372 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.858634 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.858677 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:50:45.858960 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.854266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:33263 (local address 127.15.239.195:55731)
0810 04:50:45.854524 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.854534 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.854600 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.854745 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.854746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.854747 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.854874 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.854875 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.855827 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.855828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.857050 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.857053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.858468 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.858469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.858554 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.858557 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.858628 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.858671 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":40,"thread_start_us":150,"threads_started":1}
I20260810 04:50:45.859022 19528 leader_election.cc:302] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:45.859166 19767 raft_consensus.cc:2781] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:45.859228 19767 raft_consensus.cc:482] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:45.859261 19767 raft_consensus.cc:3037] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:45.859465 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b4114288f5408ba8be56cc8b56cfbf" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935" is_pre_election: true
I20260810 04:50:45.859651 19426 raft_consensus.cc:2454] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 0.
I20260810 04:50:45.860837 19767 raft_consensus.cc:504] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.860944 19739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.856444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:47689 (local address 127.15.239.195:35431)
0810 04:50:45.856491 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.856494 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.856711 (+ 217us) server_negotiation.cc:407] Connection header received
0810 04:50:45.856840 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.856841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.856853 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.856889 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.857165 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.857987 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.859962 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.860548 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.860627 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.860637 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.860850 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.860891 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:50:45.860977 19767 leader_election.cc:288] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 election: Requested vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:45.861184 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b4114288f5408ba8be56cc8b56cfbf" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8"
I20260810 04:50:45.861277 19771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.856211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.15.239.193:47689)
0810 04:50:45.856627 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.856641 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.856748 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.856969 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.856970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.856993 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.857067 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.857070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.858186 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.858187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.859847 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.859850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.860673 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.860675 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.860744 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.860749 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.861018 (+ 269us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.861072 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":49,"thread_start_us":102,"threads_started":1}
I20260810 04:50:45.861277 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b4114288f5408ba8be56cc8b56cfbf" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935"
I20260810 04:50:45.861333 19217 raft_consensus.cc:3037] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:45.861523 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.856449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:59865 (local address 127.15.239.194:33263)
0810 04:50:45.856889 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.856892 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.856899 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:50:45.856921 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.856922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.856943 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.857017 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:45.857226 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.858059 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.860434 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.860847 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.860970 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.860981 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.861312 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.861360 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":116,"threads_started":1}
I20260810 04:50:45.861629 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b4114288f5408ba8be56cc8b56cfbf" candidate_uuid: "50a492015a264b51bc0b82b177877ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd62211ab0a476ea63318d4584971db" is_pre_election: true
I20260810 04:50:45.861686 19773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.856214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:33263 (local address 127.15.239.193:59865)
0810 04:50:45.856658 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.856670 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.856728 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.857063 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.857064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.857065 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:45.857139 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.857141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.858166 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.858168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.860343 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.860345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.861011 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.861012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.861105 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.861111 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.861169 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.861211 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":212,"spinlock_wait_cycles":16640,"thread_start_us":133,"threads_started":1}
I20260810 04:50:45.861754 19642 raft_consensus.cc:2379] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50a492015a264b51bc0b82b177877ea8 in current term 1: Already voted for candidate abd62211ab0a476ea63318d4584971db in this term.
I20260810 04:50:45.862004 19425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b4114288f5408ba8be56cc8b56cfbf" candidate_uuid: "50a492015a264b51bc0b82b177877ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935" is_pre_election: true
I20260810 04:50:45.861364 19426 raft_consensus.cc:3037] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:45.862416 19127 leader_election.cc:302] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8; no voters: abd62211ab0a476ea63318d4584971db, b4a9239d4f444937bf592e11523ab935
I20260810 04:50:45.862498 19217 raft_consensus.cc:2454] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 1.
I20260810 04:50:45.862564 19764 raft_consensus.cc:2726] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 04:50:45.862697 19528 leader_election.cc:302] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:45.862809 19767 raft_consensus.cc:2781] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:45.862948 19767 raft_consensus.cc:686] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 1 LEADER]: Becoming Leader. State: Replica: abd62211ab0a476ea63318d4584971db, State: Running, Role: LEADER
I20260810 04:50:45.863066 19767 consensus_queue.cc:237] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.863771 19426 raft_consensus.cc:2454] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 1.
I20260810 04:50:45.864621 18985 catalog_manager.cc:5495] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db reported cstate change: term changed from 0 to 1, leader changed from <none> to abd62211ab0a476ea63318d4584971db (127.15.239.195). New cstate: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } health_report { overall_health: HEALTHY } } }
Aug 10 04:50:45 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337445, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:45.917121 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.909221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57838 (local address 127.15.239.254:42925)
0810 04:50:45.909319 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:45.909321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:45.909587 (+ 266us) server_negotiation.cc:407] Connection header received
0810 04:50:45.909644 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:45.909645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:45.909656 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:45.909717 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:45.910317 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.910889 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.911659 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.911896 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.911966 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.914373 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:45.914374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:45.914375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:45.914382 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:45.915899 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.916311 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.916312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.916312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.916396 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:45.916631 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:45.916632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:45.916632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:45.916747 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:45.916802 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:45.916955 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 04:50:45.917037 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 04:50:45.917332 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:45.909206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42925 (local address 127.0.0.1:57838)
0810 04:50:45.909458 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:45.909470 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:45.909589 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:45.909732 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:45.909733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:45.910139 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:45.910205 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.910207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.910979 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.910980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.911556 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:45.911558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:45.911972 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:45.911973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:45.912036 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:45.912654 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:45.912659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:45.914290 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:45.915982 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.915990 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.915993 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.916222 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.916487 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:45.916488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:45.916489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:45.916562 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:45.916809 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:45.916816 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:45.916863 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 04:50:45.916938 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 04:50:45.917157 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":90,"thread_start_us":183,"threads_started":1}
I20260810 04:50:45.919963 18985 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:57838:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 04:50:45.920298 18985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:45.922456 19607 tablet_service.cc:1467] Processing CreateTablet for tablet 18ddf1f612b9417dba194d60422263f4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=afb88882814b4d1fa5ca5d04b8a26503]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:50:45.922438 19393 tablet_service.cc:1467] Processing CreateTablet for tablet 18ddf1f612b9417dba194d60422263f4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=afb88882814b4d1fa5ca5d04b8a26503]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:50:45.922456 19188 tablet_service.cc:1467] Processing CreateTablet for tablet 18ddf1f612b9417dba194d60422263f4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=afb88882814b4d1fa5ca5d04b8a26503]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:50:45.922695 19607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18ddf1f612b9417dba194d60422263f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.922703 19393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18ddf1f612b9417dba194d60422263f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.922722 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18ddf1f612b9417dba194d60422263f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:45.924495 19747 tablet_bootstrap.cc:492] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: Bootstrap starting.
I20260810 04:50:45.924582 19757 tablet_bootstrap.cc:492] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: Bootstrap starting.
I20260810 04:50:45.924593 19748 tablet_bootstrap.cc:492] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: Bootstrap starting.
I20260810 04:50:45.925040 19748 tablet_bootstrap.cc:654] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.925130 19757 tablet_bootstrap.cc:654] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.925374 19747 tablet_bootstrap.cc:654] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:45.926066 19748 tablet_bootstrap.cc:492] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: No bootstrap required, opened a new log
I20260810 04:50:45.926066 19757 tablet_bootstrap.cc:492] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: No bootstrap required, opened a new log
I20260810 04:50:45.926126 19757 ts_tablet_manager.cc:1397] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:50:45.926126 19748 ts_tablet_manager.cc:1397] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:50:45.926311 19748 raft_consensus.cc:348] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.926311 19757 raft_consensus.cc:348] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.926398 19748 raft_consensus.cc:374] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.926398 19757 raft_consensus.cc:374] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.926421 19748 raft_consensus.cc:729] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd62211ab0a476ea63318d4584971db, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.926432 19757 raft_consensus.cc:729] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a9239d4f444937bf592e11523ab935, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.926474 19748 consensus_queue.cc:260] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.926491 19757 consensus_queue.cc:260] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.926587 19748 ts_tablet_manager.cc:1428] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.926600 19757 ts_tablet_manager.cc:1428] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 04:50:45.926641 19767 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:45.926753 19767 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:45.926743 19766 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:45.926841 19766 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:45.926851 19747 tablet_bootstrap.cc:492] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: No bootstrap required, opened a new log
I20260810 04:50:45.926900 19747 ts_tablet_manager.cc:1397] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:50:45.927107 19747 raft_consensus.cc:348] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.927201 19747 raft_consensus.cc:374] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:45.927224 19747 raft_consensus.cc:729] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a492015a264b51bc0b82b177877ea8, State: Initialized, Role: FOLLOWER
I20260810 04:50:45.927282 19747 consensus_queue.cc:260] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:45.927395 19747 ts_tablet_manager.cc:1428] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:45.927524 19764 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:45.927657 19764 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 04:50:45.967670 19716 tablet.cc:2369] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:50:46.030205 19489 tablet.cc:2369] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:50:46.178627 19767 raft_consensus.cc:482] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:46.178789 19767 raft_consensus.cc:504] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.179050 19767 leader_election.cc:288] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:46.179483 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18ddf1f612b9417dba194d60422263f4" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935" is_pre_election: true
I20260810 04:50:46.179484 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18ddf1f612b9417dba194d60422263f4" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8" is_pre_election: true
I20260810 04:50:46.179629 19426 raft_consensus.cc:2454] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 0.
I20260810 04:50:46.179629 19217 raft_consensus.cc:2454] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 0.
I20260810 04:50:46.179811 19528 leader_election.cc:302] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:46.179972 19767 raft_consensus.cc:2781] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:46.180051 19767 raft_consensus.cc:482] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:46.180068 19767 raft_consensus.cc:3037] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:46.180969 19767 raft_consensus.cc:504] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.181109 19767 leader_election.cc:288] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 election: Requested vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:46.181320 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18ddf1f612b9417dba194d60422263f4" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8"
I20260810 04:50:46.181339 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18ddf1f612b9417dba194d60422263f4" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935"
I20260810 04:50:46.181440 19426 raft_consensus.cc:3037] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:46.181429 19217 raft_consensus.cc:3037] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:46.182425 19217 raft_consensus.cc:2454] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 1.
I20260810 04:50:46.182435 19426 raft_consensus.cc:2454] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 1.
I20260810 04:50:46.182627 19528 leader_election.cc:302] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:46.182741 19767 raft_consensus.cc:2781] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:46.182801 19767 raft_consensus.cc:686] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [term 1 LEADER]: Becoming Leader. State: Replica: abd62211ab0a476ea63318d4584971db, State: Running, Role: LEADER
I20260810 04:50:46.182862 19767 consensus_queue.cc:237] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.183357 19777 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: TxnStatusTablet state changed. Reason: New leader abd62211ab0a476ea63318d4584971db. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.183458 19777 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:50:46.183730 19797 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 04:50:46.183732 18985 catalog_manager.cc:5495] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db reported cstate change: term changed from 0 to 1, leader changed from <none> to abd62211ab0a476ea63318d4584971db (127.15.239.195). New cstate: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } health_report { overall_health: HEALTHY } } }
I20260810 04:50:46.183908 19797 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 04:50:46.212602 19739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:46.209700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54930 (local address 127.15.239.195:35431)
0810 04:50:46.209790 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:46.209792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:46.209805 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:50:46.209926 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:46.209927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:46.209958 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:46.210048 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:46.210214 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.210745 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.211627 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.211844 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.211927 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:46.212191 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:46.212322 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:46.212422 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:46.212467 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 04:50:46.212492 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 04:50:46.212602 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:46.209634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.0.0.1:54930)
0810 04:50:46.209754 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:46.209770 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:46.209830 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:46.210050 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:46.210052 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:46.210053 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:46.210131 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:46.210135 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.210902 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.210903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:46.211531 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:46.211534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.211927 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.211928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:46.212059 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:46.212082 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:46.212390 (+ 308us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:46.212402 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 04:50:46.212452 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:50:46.212520 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 04:50:46.215035 19426 raft_consensus.cc:1261] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Refusing update from remote peer abd62211ab0a476ea63318d4584971db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:46.215126 19217 raft_consensus.cc:1261] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Refusing update from remote peer abd62211ab0a476ea63318d4584971db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:46.215549 19777 consensus_queue.cc:1035] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:46.215731 19767 consensus_queue.cc:1035] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:46.217250 19764 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: TxnStatusTablet state changed. Reason: New leader abd62211ab0a476ea63318d4584971db. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.217399 19764 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:46.217497 19766 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: TxnStatusTablet state changed. Reason: New leader abd62211ab0a476ea63318d4584971db. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.217585 19766 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:46.218462 19777 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.218562 19777 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:50:46.218703 19766 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.218799 19766 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P b4a9239d4f444937bf592e11523ab935: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:46.218772 19802 mvcc.cc:205] Tried to move back new op lower bound from 7316838179693551616 to 7316838179565547520. Current Snapshot: MvccSnapshot[applied={T|T < 7316838179693551616}]
I20260810 04:50:46.219566 19803 mvcc.cc:205] Tried to move back new op lower bound from 7316838179693551616 to 7316838179565547520. Current Snapshot: MvccSnapshot[applied={T|T < 7316838179693551616}]
I20260810 04:50:46.220000 19767 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.220119 19767 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P abd62211ab0a476ea63318d4584971db: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:50:46.220821 19764 tablet_replica.cc:439] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } } }
I20260810 04:50:46.220939 19764 tablet_replica.cc:442] T 18ddf1f612b9417dba194d60422263f4 P 50a492015a264b51bc0b82b177877ea8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:50:46.225827 19739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:46.223325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54944 (local address 127.15.239.195:35431)
0810 04:50:46.223376 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:46.223378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:46.223388 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:50:46.223453 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:46.223453 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:46.223465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:46.223517 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:46.223680 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.224258 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.225102 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.225304 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.225390 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:46.225553 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:46.225595 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:46.225659 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:46.225726 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 04:50:46.225746 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:50:46.231853 19739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:46.228950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:41883 (local address 127.15.239.195:35431)
0810 04:50:46.229008 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:46.229009 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:46.229202 (+ 193us) server_negotiation.cc:407] Connection header received
0810 04:50:46.229273 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:46.229274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:46.229282 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:46.229330 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:46.229473 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.229915 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.231085 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.231272 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.231339 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:46.231576 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:46.231603 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:46.231643 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:46.231725 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:50:46.231745 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":32}
I20260810 04:50:46.231943 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:46.228797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.15.239.195:41883)
0810 04:50:46.229116 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:46.229128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:46.229215 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:46.229342 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:46.229343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:46.229344 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:46.229415 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:46.229417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.229994 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.229995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:46.230979 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:46.230982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:46.231358 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:46.231359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:46.231431 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:46.231448 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:46.231667 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:46.231669 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:50:46.231723 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:50:46.231782 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":205,"threads_started":1}
I20260810 04:50:46.234498 19426 raft_consensus.cc:1261] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Refusing update from remote peer abd62211ab0a476ea63318d4584971db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:46.234673 19217 raft_consensus.cc:1261] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Refusing update from remote peer abd62211ab0a476ea63318d4584971db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:46.234779 19811 consensus_queue.cc:1035] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:46.234877 19767 consensus_queue.cc:1035] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:46.251204 18985 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:46.251353 18985 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:46.252518 18985 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Sending DeleteTablet for 3 replicas of tablet 05b4114288f5408ba8be56cc8b56cfbf
I20260810 04:50:46.252978 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 05b4114288f5408ba8be56cc8b56cfbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:46 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54588
I20260810 04:50:46.253273 19605 tablet_service.cc:1514] Processing DeleteTablet for tablet 05b4114288f5408ba8be56cc8b56cfbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:46 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54922
I20260810 04:50:46.253314 19825 tablet_replica.cc:330] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: stopping tablet replica
I20260810 04:50:46.253286 18985 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 04:50:46.253479 19825 raft_consensus.cc:2229] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 04:50:46.253500 18985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:46.253557 19825 raft_consensus.cc:2258] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:46.254002 19393 tablet_service.cc:1514] Processing DeleteTablet for tablet 05b4114288f5408ba8be56cc8b56cfbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:46 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:32976
I20260810 04:50:46.254379 19825 ts_tablet_manager.cc:1905] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:46.255151 19605 tablet_service.cc:1467] Processing CreateTablet for tablet 019bbc6190b9455290998a3b6b4e2be1 (DEFAULT_TABLE table=test-table [id=b25158526542459da923d926d8362bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:46.255184 19393 tablet_service.cc:1467] Processing CreateTablet for tablet 019bbc6190b9455290998a3b6b4e2be1 (DEFAULT_TABLE table=test-table [id=b25158526542459da923d926d8362bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:46.255300 19605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 019bbc6190b9455290998a3b6b4e2be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:46.255329 19393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 019bbc6190b9455290998a3b6b4e2be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:46.256805 19825 ts_tablet_manager.cc:1918] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:46.256887 19188 tablet_service.cc:1467] Processing CreateTablet for tablet 019bbc6190b9455290998a3b6b4e2be1 (DEFAULT_TABLE table=test-table [id=b25158526542459da923d926d8362bd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:46.256970 19748 tablet_bootstrap.cc:492] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Bootstrap starting.
I20260810 04:50:46.257026 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 019bbc6190b9455290998a3b6b4e2be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:46.257228 19757 tablet_bootstrap.cc:492] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Bootstrap starting.
I20260810 04:50:46.257316 19748 tablet_bootstrap.cc:654] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:46.257694 19757 tablet_bootstrap.cc:654] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:46.258068 19828 tablet_replica.cc:330] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: stopping tablet replica
I20260810 04:50:46.258205 19827 tablet_replica.cc:330] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: stopping tablet replica
I20260810 04:50:46.258354 19827 raft_consensus.cc:2229] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:50:46.258528 19828 raft_consensus.cc:2229] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:46.258608 19747 tablet_bootstrap.cc:492] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Bootstrap starting.
I20260810 04:50:46.256883 19825 log.cc:1196] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/05b4114288f5408ba8be56cc8b56cfbf
I20260810 04:50:46.258787 19828 raft_consensus.cc:2258] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:46.258919 19827 raft_consensus.cc:2258] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:46.259037 19825 ts_tablet_manager.cc:1939] T 05b4114288f5408ba8be56cc8b56cfbf P 50a492015a264b51bc0b82b177877ea8: Deleting consensus metadata
I20260810 04:50:46.259123 19747 tablet_bootstrap.cc:654] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:46.259763 19827 ts_tablet_manager.cc:1905] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:46.259881 19828 ts_tablet_manager.cc:1905] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:46.260375 19748 tablet_bootstrap.cc:492] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: No bootstrap required, opened a new log
I20260810 04:50:46.260443 19748 ts_tablet_manager.cc:1397] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:50:46.260629 19748 raft_consensus.cc:348] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.260730 19748 raft_consensus.cc:374] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:46.260752 19748 raft_consensus.cc:729] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd62211ab0a476ea63318d4584971db, State: Initialized, Role: FOLLOWER
I20260810 04:50:46.260802 19748 consensus_queue.cc:260] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.260928 19748 ts_tablet_manager.cc:1428] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:46.261679 19828 ts_tablet_manager.cc:1918] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:46.261762 19828 log.cc:1196] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/05b4114288f5408ba8be56cc8b56cfbf
I20260810 04:50:46.261826 19827 ts_tablet_manager.cc:1918] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:46.261896 19827 log.cc:1196] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/05b4114288f5408ba8be56cc8b56cfbf
I20260810 04:50:46.262059 19828 ts_tablet_manager.cc:1939] T 05b4114288f5408ba8be56cc8b56cfbf P b4a9239d4f444937bf592e11523ab935: Deleting consensus metadata
I20260810 04:50:46.262283 19827 ts_tablet_manager.cc:1939] T 05b4114288f5408ba8be56cc8b56cfbf P abd62211ab0a476ea63318d4584971db: Deleting consensus metadata
I20260810 04:50:46.262532 18965 catalog_manager.cc:4841] TS b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263): tablet 05b4114288f5408ba8be56cc8b56cfbf (table test-table [id=83ee5dc711214c1ca97e682e3e2a0710]) successfully deleted
I20260810 04:50:46.262759 18962 catalog_manager.cc:4841] TS abd62211ab0a476ea63318d4584971db (127.15.239.195:35431): tablet 05b4114288f5408ba8be56cc8b56cfbf (table test-table [id=83ee5dc711214c1ca97e682e3e2a0710]) successfully deleted
I20260810 04:50:46.262791 19757 tablet_bootstrap.cc:492] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: No bootstrap required, opened a new log
I20260810 04:50:46.262841 19757 ts_tablet_manager.cc:1397] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260810 04:50:46.263003 19757 raft_consensus.cc:348] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.263095 19757 raft_consensus.cc:374] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:46.263118 19757 raft_consensus.cc:729] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a9239d4f444937bf592e11523ab935, State: Initialized, Role: FOLLOWER
I20260810 04:50:46.263159 19757 consensus_queue.cc:260] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.263231 18965 catalog_manager.cc:4841] TS 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285): tablet 05b4114288f5408ba8be56cc8b56cfbf (table test-table [id=83ee5dc711214c1ca97e682e3e2a0710]) successfully deleted
I20260810 04:50:46.263270 19757 ts_tablet_manager.cc:1428] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 04:50:46.263921 19747 tablet_bootstrap.cc:492] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: No bootstrap required, opened a new log
I20260810 04:50:46.264002 19747 ts_tablet_manager.cc:1397] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260810 04:50:46.264200 19747 raft_consensus.cc:348] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.264290 19747 raft_consensus.cc:374] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:46.264315 19747 raft_consensus.cc:729] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a492015a264b51bc0b82b177877ea8, State: Initialized, Role: FOLLOWER
I20260810 04:50:46.264382 19747 consensus_queue.cc:260] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.264492 19747 ts_tablet_manager.cc:1428] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:46.473842 19811 raft_consensus.cc:482] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:46.474009 19811 raft_consensus.cc:504] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.474267 19811 leader_election.cc:288] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:46.474671 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019bbc6190b9455290998a3b6b4e2be1" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8" is_pre_election: true
I20260810 04:50:46.474699 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019bbc6190b9455290998a3b6b4e2be1" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935" is_pre_election: true
I20260810 04:50:46.474833 19426 raft_consensus.cc:2454] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 0.
I20260810 04:50:46.474828 19217 raft_consensus.cc:2454] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 0.
I20260810 04:50:46.475047 19528 leader_election.cc:302] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:46.475225 19811 raft_consensus.cc:2781] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:46.475286 19811 raft_consensus.cc:482] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:46.475335 19811 raft_consensus.cc:3037] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:46.476490 19811 raft_consensus.cc:504] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.476609 19811 leader_election.cc:288] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 election: Requested vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263)
I20260810 04:50:46.476830 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019bbc6190b9455290998a3b6b4e2be1" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8"
I20260810 04:50:46.476940 19217 raft_consensus.cc:3037] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:46.476868 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019bbc6190b9455290998a3b6b4e2be1" candidate_uuid: "abd62211ab0a476ea63318d4584971db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935"
I20260810 04:50:46.476984 19426 raft_consensus.cc:3037] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:46.477983 19217 raft_consensus.cc:2454] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 1.
I20260810 04:50:46.477985 19426 raft_consensus.cc:2454] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abd62211ab0a476ea63318d4584971db in term 1.
I20260810 04:50:46.478191 19528 leader_election.cc:302] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd62211ab0a476ea63318d4584971db, b4a9239d4f444937bf592e11523ab935; no voters:
I20260810 04:50:46.478323 19811 raft_consensus.cc:2781] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:46.478397 19811 raft_consensus.cc:686] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 1 LEADER]: Becoming Leader. State: Replica: abd62211ab0a476ea63318d4584971db, State: Running, Role: LEADER
I20260810 04:50:46.478474 19811 consensus_queue.cc:237] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:46.479318 18985 catalog_manager.cc:5495] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db reported cstate change: term changed from 0 to 1, leader changed from <none> to abd62211ab0a476ea63318d4584971db (127.15.239.195). New cstate: current_term: 1 leader_uuid: "abd62211ab0a476ea63318d4584971db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } health_report { overall_health: HEALTHY } } }
I20260810 04:50:46.492501 19217 raft_consensus.cc:1261] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Refusing update from remote peer abd62211ab0a476ea63318d4584971db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:46.492501 19426 raft_consensus.cc:1261] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Refusing update from remote peer abd62211ab0a476ea63318d4584971db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:46.492775 19777 consensus_queue.cc:1035] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:46.492951 19767 consensus_queue.cc:1035] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:46.494498 19804 mvcc.cc:205] Tried to move back new op lower bound from 7316838180831776768 to 7316838180776415232. Current Snapshot: MvccSnapshot[applied={T|T < 7316838180831776768}]
W20260810 04:50:46.498229 19802 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 04:50:48.019073 18984 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:48.019228 18984 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:48.020452 18984 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Sending DeleteTablet for 3 replicas of tablet 019bbc6190b9455290998a3b6b4e2be1
I20260810 04:50:48.020825 19393 tablet_service.cc:1514] Processing DeleteTablet for tablet 019bbc6190b9455290998a3b6b4e2be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:48 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:32976
I20260810 04:50:48.020838 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 019bbc6190b9455290998a3b6b4e2be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:48 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54588
I20260810 04:50:48.021088 19605 tablet_service.cc:1514] Processing DeleteTablet for tablet 019bbc6190b9455290998a3b6b4e2be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:48 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54922
I20260810 04:50:48.021322 19875 tablet_replica.cc:330] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: stopping tablet replica
I20260810 04:50:48.021409 19875 raft_consensus.cc:2229] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:50:48.021528 19875 raft_consensus.cc:2258] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:48.024003 19875 ts_tablet_manager.cc:1905] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:48.024791 19873 tablet_replica.cc:330] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: stopping tablet replica
I20260810 04:50:48.024902 19873 raft_consensus.cc:2229] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:48.024967 19873 raft_consensus.cc:2258] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:48.025269 19873 ts_tablet_manager.cc:1905] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:48.026304 19875 ts_tablet_manager.cc:1918] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:50:48.026376 19875 log.cc:1196] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/019bbc6190b9455290998a3b6b4e2be1
I20260810 04:50:48.026701 19875 ts_tablet_manager.cc:1939] T 019bbc6190b9455290998a3b6b4e2be1 P abd62211ab0a476ea63318d4584971db: Deleting consensus metadata
I20260810 04:50:48.026978 19873 ts_tablet_manager.cc:1918] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:50:48.027057 19873 log.cc:1196] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/019bbc6190b9455290998a3b6b4e2be1
I20260810 04:50:48.027185 18962 catalog_manager.cc:4841] TS abd62211ab0a476ea63318d4584971db (127.15.239.195:35431): tablet 019bbc6190b9455290998a3b6b4e2be1 (table test-table [id=b25158526542459da923d926d8362bd1]) successfully deleted
I20260810 04:50:48.027345 19873 ts_tablet_manager.cc:1939] T 019bbc6190b9455290998a3b6b4e2be1 P b4a9239d4f444937bf592e11523ab935: Deleting consensus metadata
I20260810 04:50:48.027736 18965 catalog_manager.cc:4841] TS b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263): tablet 019bbc6190b9455290998a3b6b4e2be1 (table test-table [id=b25158526542459da923d926d8362bd1]) successfully deleted
I20260810 04:50:48.028160 19874 tablet_replica.cc:330] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: stopping tablet replica
I20260810 04:50:48.028260 19874 raft_consensus.cc:2229] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:48.028321 19874 raft_consensus.cc:2258] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:48.028630 19874 ts_tablet_manager.cc:1905] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:48.030881 19874 ts_tablet_manager.cc:1918] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:50:48.030970 19874 log.cc:1196] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/019bbc6190b9455290998a3b6b4e2be1
I20260810 04:50:48.031227 19874 ts_tablet_manager.cc:1939] T 019bbc6190b9455290998a3b6b4e2be1 P 50a492015a264b51bc0b82b177877ea8: Deleting consensus metadata
I20260810 04:50:48.031708 18965 catalog_manager.cc:4841] TS 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285): tablet 019bbc6190b9455290998a3b6b4e2be1 (table test-table [id=b25158526542459da923d926d8362bd1]) successfully deleted
Aug 10 04:50:48 dist-test-slave-kvfs krb5kdc[18916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:50:48 dist-test-slave-kvfs krb5kdc[18916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337448, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:48.055830 19892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.046146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57850 (local address 127.15.239.254:42925)
0810 04:50:48.046344 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.046347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.046359 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:50:48.046445 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.046446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.046458 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.046534 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:48.047231 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.047946 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.048852 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.049076 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.049133 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.052668 (+ 3535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:48.052670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:48.052671 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:48.052680 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:48.054700 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:48.055068 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:48.055069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:48.055070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:48.055134 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:48.055309 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:48.055310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:48.055310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:48.055439 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:48.055527 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.055621 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.055695 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":128,"threads_started":1}
I20260810 04:50:48.057727 18984 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:50:48.057936 18984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:48.059827 19188 tablet_service.cc:1467] Processing CreateTablet for tablet 584887c11b34458ab4d490001a5b24bf (DEFAULT_TABLE table=test-table [id=a65234578cc84db6a52ea460076b325f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:48.059827 19605 tablet_service.cc:1467] Processing CreateTablet for tablet 584887c11b34458ab4d490001a5b24bf (DEFAULT_TABLE table=test-table [id=a65234578cc84db6a52ea460076b325f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:48.059827 19393 tablet_service.cc:1467] Processing CreateTablet for tablet 584887c11b34458ab4d490001a5b24bf (DEFAULT_TABLE table=test-table [id=a65234578cc84db6a52ea460076b325f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:48.060057 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584887c11b34458ab4d490001a5b24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:48.060065 19605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584887c11b34458ab4d490001a5b24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:48.060078 19393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584887c11b34458ab4d490001a5b24bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:48.061431 19896 tablet_bootstrap.cc:492] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Bootstrap starting.
I20260810 04:50:48.061896 19897 tablet_bootstrap.cc:492] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Bootstrap starting.
I20260810 04:50:48.062280 19896 tablet_bootstrap.cc:654] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:48.062309 19897 tablet_bootstrap.cc:654] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:48.062718 19898 tablet_bootstrap.cc:492] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Bootstrap starting.
I20260810 04:50:48.063148 19897 tablet_bootstrap.cc:492] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: No bootstrap required, opened a new log
I20260810 04:50:48.063217 19898 tablet_bootstrap.cc:654] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:48.063218 19897 ts_tablet_manager.cc:1397] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:48.063306 19896 tablet_bootstrap.cc:492] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: No bootstrap required, opened a new log
I20260810 04:50:48.063369 19896 ts_tablet_manager.cc:1397] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:50:48.063544 19896 raft_consensus.cc:348] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.063694 19896 raft_consensus.cc:374] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:48.063726 19896 raft_consensus.cc:729] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a492015a264b51bc0b82b177877ea8, State: Initialized, Role: FOLLOWER
I20260810 04:50:48.063733 19897 raft_consensus.cc:348] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.063783 19896 consensus_queue.cc:260] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.063872 19897 raft_consensus.cc:374] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:48.063911 19897 raft_consensus.cc:729] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a9239d4f444937bf592e11523ab935, State: Initialized, Role: FOLLOWER
I20260810 04:50:48.063970 19897 consensus_queue.cc:260] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.064054 19896 ts_tablet_manager.cc:1428] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:48.064195 19897 ts_tablet_manager.cc:1428] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:48.064532 19898 tablet_bootstrap.cc:492] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: No bootstrap required, opened a new log
I20260810 04:50:48.064648 19898 ts_tablet_manager.cc:1397] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:50:48.064829 19898 raft_consensus.cc:348] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.064916 19898 raft_consensus.cc:374] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:48.064937 19898 raft_consensus.cc:729] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd62211ab0a476ea63318d4584971db, State: Initialized, Role: FOLLOWER
I20260810 04:50:48.065011 19898 consensus_queue.cc:260] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.065153 19898 ts_tablet_manager.cc:1428] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:48.259936 19904 raft_consensus.cc:482] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:48.260128 19904 raft_consensus.cc:504] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.260640 19904 leader_election.cc:288] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), abd62211ab0a476ea63318d4584971db (127.15.239.195:35431)
I20260810 04:50:48.264631 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.261097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:58501 (local address 127.15.239.195:35431)
0810 04:50:48.261384 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.261387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.261631 (+ 244us) server_negotiation.cc:407] Connection header received
0810 04:50:48.261713 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.261714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.261726 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.261869 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:48.262055 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.262576 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.263701 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.264200 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.264292 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.264305 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.264479 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.264526 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":182,"threads_started":1}
I20260810 04:50:48.264658 19906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.260939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.15.239.194:58501)
0810 04:50:48.261545 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:48.261556 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:48.261646 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:48.261877 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:48.261878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:48.261880 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:48.261961 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.261962 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.262666 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.262667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.263603 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.263606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.264291 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.264292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.264392 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.264397 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:50:48.264471 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:50:48.264519 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":2,"thread_start_us":342,"threads_started":1}
I20260810 04:50:48.264678 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.261113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:42595 (local address 127.15.239.193:39285)
0810 04:50:48.261382 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.261385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.261503 (+ 118us) server_negotiation.cc:407] Connection header received
0810 04:50:48.261602 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.261603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.261624 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.261717 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:50:48.261929 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.262581 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.263712 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.264214 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.264314 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.264328 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.264516 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.264567 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":165,"threads_started":1}
I20260810 04:50:48.264669 19908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.260908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39285 (local address 127.15.239.194:42595)
0810 04:50:48.261380 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:48.261395 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:48.261524 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:48.261723 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:48.261724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:48.261728 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:50:48.261844 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.261846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.262680 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.262682 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.263605 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.263608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.264337 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.264339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.264417 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.264421 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:48.264504 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 04:50:48.264551 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":53,"thread_start_us":371,"threads_started":1}
I20260810 04:50:48.264962 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584887c11b34458ab4d490001a5b24bf" candidate_uuid: "b4a9239d4f444937bf592e11523ab935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8" is_pre_election: true
I20260810 04:50:48.265089 19217 raft_consensus.cc:2454] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a9239d4f444937bf592e11523ab935 in term 0.
I20260810 04:50:48.265306 19327 leader_election.cc:302] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, b4a9239d4f444937bf592e11523ab935; no voters:
I20260810 04:50:48.265475 19904 raft_consensus.cc:2781] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:48.265527 19904 raft_consensus.cc:482] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:48.265552 19904 raft_consensus.cc:3037] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:48.265523 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584887c11b34458ab4d490001a5b24bf" candidate_uuid: "b4a9239d4f444937bf592e11523ab935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd62211ab0a476ea63318d4584971db" is_pre_election: true
I20260810 04:50:48.265650 19642 raft_consensus.cc:2454] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a9239d4f444937bf592e11523ab935 in term 0.
I20260810 04:50:48.266541 19904 raft_consensus.cc:504] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.266709 19904 leader_election.cc:288] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [CANDIDATE]: Term 1 election: Requested vote from peers 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285), abd62211ab0a476ea63318d4584971db (127.15.239.195:35431)
I20260810 04:50:48.266916 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584887c11b34458ab4d490001a5b24bf" candidate_uuid: "b4a9239d4f444937bf592e11523ab935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd62211ab0a476ea63318d4584971db"
I20260810 04:50:48.266916 19217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584887c11b34458ab4d490001a5b24bf" candidate_uuid: "b4a9239d4f444937bf592e11523ab935" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a492015a264b51bc0b82b177877ea8"
I20260810 04:50:48.267024 19642 raft_consensus.cc:3037] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:48.267025 19217 raft_consensus.cc:3037] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:48.267959 19217 raft_consensus.cc:2454] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a9239d4f444937bf592e11523ab935 in term 1.
I20260810 04:50:48.268006 19642 raft_consensus.cc:2454] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a9239d4f444937bf592e11523ab935 in term 1.
I20260810 04:50:48.268193 19325 leader_election.cc:302] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abd62211ab0a476ea63318d4584971db, b4a9239d4f444937bf592e11523ab935; no voters:
I20260810 04:50:48.268301 19904 raft_consensus.cc:2781] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:48.268497 19904 raft_consensus.cc:686] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 1 LEADER]: Becoming Leader. State: Replica: b4a9239d4f444937bf592e11523ab935, State: Running, Role: LEADER
I20260810 04:50:48.268590 19904 consensus_queue.cc:237] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.269502 18985 catalog_manager.cc:5495] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4a9239d4f444937bf592e11523ab935 (127.15.239.194). New cstate: current_term: 1 leader_uuid: "b4a9239d4f444937bf592e11523ab935" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } health_report { overall_health: UNKNOWN } } }
I20260810 04:50:48.298079 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.295028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32990 (local address 127.15.239.194:33263)
0810 04:50:48.295226 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.295228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.295235 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:50:48.295282 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.295282 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.295322 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.295435 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:48.295610 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.296268 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.297130 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.297379 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.297465 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.297632 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.297790 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.297889 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.297915 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.297943 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":112,"threads_started":1}
I20260810 04:50:48.304291 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.301576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:35901 (local address 127.15.239.195:35431)
0810 04:50:48.301727 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.301733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.301744 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:50:48.301770 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.301771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.301782 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.301840 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:48.301990 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.302487 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.303403 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.303613 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.303671 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.303887 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.303919 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.303963 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.304137 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.304163 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260810 04:50:48.304323 19921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.301427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.15.239.194:35901)
0810 04:50:48.301647 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:48.301658 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:48.301723 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:48.301853 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:48.301853 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:48.301855 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:48.301917 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.301918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.302592 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.302593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.303314 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.303316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.303703 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.303704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.303772 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.303789 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.303986 (+ 197us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.303988 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:50:48.304119 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 04:50:48.304207 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":117,"threads_started":1}
I20260810 04:50:48.307142 19217 raft_consensus.cc:1261] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Refusing update from remote peer b4a9239d4f444937bf592e11523ab935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:48.307196 19642 raft_consensus.cc:1261] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Refusing update from remote peer b4a9239d4f444937bf592e11523ab935: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:48.307467 19913 consensus_queue.cc:1035] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:48.307669 19904 consensus_queue.cc:1035] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:48.317077 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.314293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:60293 (local address 127.15.239.194:33263)
0810 04:50:48.314338 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.314341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.314471 (+ 130us) server_negotiation.cc:407] Connection header received
0810 04:50:48.314658 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.314659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.314669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.314712 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:48.314862 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.315375 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.316447 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.316649 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.316706 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.316877 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.316907 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.316954 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.316988 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.317008 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:50:48.317102 19929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.314232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:33263 (local address 127.15.239.195:60293)
0810 04:50:48.314402 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:48.314414 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:48.314584 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:48.314716 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:48.314716 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:48.314718 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:48.314823 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.314825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.315463 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.315464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.316362 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.316366 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.316739 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.316740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.316794 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.316800 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.316953 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.316954 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:50:48.316985 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 04:50:48.317030 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":118,"threads_started":1}
I20260810 04:50:48.327713 18985 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:48.327863 18985 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:48.328761 18985 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Sending DeleteTablet for 3 replicas of tablet 584887c11b34458ab4d490001a5b24bf
I20260810 04:50:48.329061 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet 584887c11b34458ab4d490001a5b24bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:48 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54588
I20260810 04:50:48.329206 19393 tablet_service.cc:1514] Processing DeleteTablet for tablet 584887c11b34458ab4d490001a5b24bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:48 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:32976
I20260810 04:50:48.329269 19605 tablet_service.cc:1514] Processing DeleteTablet for tablet 584887c11b34458ab4d490001a5b24bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:48 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54922
I20260810 04:50:48.329316 19874 tablet_replica.cc:330] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: stopping tablet replica
I20260810 04:50:48.329381 19874 raft_consensus.cc:2229] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:48.329394 19873 tablet_replica.cc:330] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: stopping tablet replica
I20260810 04:50:48.329437 19874 raft_consensus.cc:2258] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:48.329471 19873 raft_consensus.cc:2229] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:50:48.329591 19873 raft_consensus.cc:2258] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:48.329694 19875 tablet_replica.cc:330] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: stopping tablet replica
I20260810 04:50:48.329762 19875 raft_consensus.cc:2229] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:48.329810 19875 raft_consensus.cc:2258] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:48.329931 19874 ts_tablet_manager.cc:1905] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:48.330149 19875 ts_tablet_manager.cc:1905] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:48.330113 18985 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57850:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:50:48.330298 18985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:50:48.332136 19874 ts_tablet_manager.cc:1918] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:48.332204 19874 log.cc:1196] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/584887c11b34458ab4d490001a5b24bf
I20260810 04:50:48.332290 19873 ts_tablet_manager.cc:1905] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:48.332474 19874 ts_tablet_manager.cc:1939] T 584887c11b34458ab4d490001a5b24bf P 50a492015a264b51bc0b82b177877ea8: Deleting consensus metadata
I20260810 04:50:48.332860 18965 catalog_manager.cc:4841] TS 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285): tablet 584887c11b34458ab4d490001a5b24bf (table test-table [id=a65234578cc84db6a52ea460076b325f]) successfully deleted
I20260810 04:50:48.333494 19393 tablet_service.cc:1467] Processing CreateTablet for tablet d04017161b1d4b60a30ee4bda7e39d1c (DEFAULT_TABLE table=test-table [id=7abe1c0fe8cc41e491c444592d7adf10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:48.333493 19605 tablet_service.cc:1467] Processing CreateTablet for tablet d04017161b1d4b60a30ee4bda7e39d1c (DEFAULT_TABLE table=test-table [id=7abe1c0fe8cc41e491c444592d7adf10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:48.333622 19393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d04017161b1d4b60a30ee4bda7e39d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:48.334069 19873 ts_tablet_manager.cc:1918] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:48.334131 19873 log.cc:1196] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/584887c11b34458ab4d490001a5b24bf
I20260810 04:50:48.334300 19875 ts_tablet_manager.cc:1918] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:50:48.334360 19875 log.cc:1196] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/584887c11b34458ab4d490001a5b24bf
I20260810 04:50:48.334367 19873 ts_tablet_manager.cc:1939] T 584887c11b34458ab4d490001a5b24bf P b4a9239d4f444937bf592e11523ab935: Deleting consensus metadata
I20260810 04:50:48.334622 19875 ts_tablet_manager.cc:1939] T 584887c11b34458ab4d490001a5b24bf P abd62211ab0a476ea63318d4584971db: Deleting consensus metadata
I20260810 04:50:48.334762 19605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d04017161b1d4b60a30ee4bda7e39d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:48.335109 19897 tablet_bootstrap.cc:492] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Bootstrap starting.
I20260810 04:50:48.335598 19897 tablet_bootstrap.cc:654] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:48.336040 19188 tablet_service.cc:1467] Processing CreateTablet for tablet d04017161b1d4b60a30ee4bda7e39d1c (DEFAULT_TABLE table=test-table [id=7abe1c0fe8cc41e491c444592d7adf10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:50:48.336161 19188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d04017161b1d4b60a30ee4bda7e39d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:48.336465 19898 tablet_bootstrap.cc:492] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Bootstrap starting.
I20260810 04:50:48.336838 19898 tablet_bootstrap.cc:654] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:48.336844 18962 catalog_manager.cc:4841] TS abd62211ab0a476ea63318d4584971db (127.15.239.195:35431): tablet 584887c11b34458ab4d490001a5b24bf (table test-table [id=a65234578cc84db6a52ea460076b325f]) successfully deleted
I20260810 04:50:48.337168 18965 catalog_manager.cc:4841] TS b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263): tablet 584887c11b34458ab4d490001a5b24bf (table test-table [id=a65234578cc84db6a52ea460076b325f]) successfully deleted
I20260810 04:50:48.337527 19896 tablet_bootstrap.cc:492] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8: Bootstrap starting.
I20260810 04:50:48.337841 19897 tablet_bootstrap.cc:492] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: No bootstrap required, opened a new log
I20260810 04:50:48.337841 19898 tablet_bootstrap.cc:492] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: No bootstrap required, opened a new log
I20260810 04:50:48.337888 19897 ts_tablet_manager.cc:1397] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:50:48.337890 19898 ts_tablet_manager.cc:1397] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:48.338016 19896 tablet_bootstrap.cc:654] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:48.338024 19898 raft_consensus.cc:348] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.338109 19898 raft_consensus.cc:374] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:48.338076 19897 raft_consensus.cc:348] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.338137 19898 raft_consensus.cc:729] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd62211ab0a476ea63318d4584971db, State: Initialized, Role: FOLLOWER
I20260810 04:50:48.338146 19897 raft_consensus.cc:374] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:48.338168 19897 raft_consensus.cc:729] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a9239d4f444937bf592e11523ab935, State: Initialized, Role: FOLLOWER
I20260810 04:50:48.338213 19897 consensus_queue.cc:260] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.338201 19898 consensus_queue.cc:260] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.338321 19898 ts_tablet_manager.cc:1428] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:48.338339 19897 ts_tablet_manager.cc:1428] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:48.339119 19896 tablet_bootstrap.cc:492] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8: No bootstrap required, opened a new log
I20260810 04:50:48.339193 19896 ts_tablet_manager.cc:1397] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:50:48.339373 19896 raft_consensus.cc:348] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.339459 19896 raft_consensus.cc:374] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:48.339493 19896 raft_consensus.cc:729] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a492015a264b51bc0b82b177877ea8, State: Initialized, Role: FOLLOWER
I20260810 04:50:48.339550 19896 consensus_queue.cc:260] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.339658 19896 ts_tablet_manager.cc:1428] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:50:48.540482 19903 raft_consensus.cc:482] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:50:48.540675 19903 raft_consensus.cc:504] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.540994 19903 leader_election.cc:288] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263), abd62211ab0a476ea63318d4584971db (127.15.239.195:35431)
I20260810 04:50:48.541347 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d04017161b1d4b60a30ee4bda7e39d1c" candidate_uuid: "50a492015a264b51bc0b82b177877ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935" is_pre_election: true
I20260810 04:50:48.541365 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d04017161b1d4b60a30ee4bda7e39d1c" candidate_uuid: "50a492015a264b51bc0b82b177877ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd62211ab0a476ea63318d4584971db" is_pre_election: true
I20260810 04:50:48.541504 19642 raft_consensus.cc:2454] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a492015a264b51bc0b82b177877ea8 in term 0.
I20260810 04:50:48.541504 19426 raft_consensus.cc:2454] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a492015a264b51bc0b82b177877ea8 in term 0.
I20260810 04:50:48.541741 19117 leader_election.cc:302] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:48.541898 19903 raft_consensus.cc:2781] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:50:48.541968 19903 raft_consensus.cc:482] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:50:48.541985 19903 raft_consensus.cc:3037] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:48.542984 19903 raft_consensus.cc:504] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.543150 19903 leader_election.cc:288] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [CANDIDATE]: Term 1 election: Requested vote from peers b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263), abd62211ab0a476ea63318d4584971db (127.15.239.195:35431)
I20260810 04:50:48.543375 19426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d04017161b1d4b60a30ee4bda7e39d1c" candidate_uuid: "50a492015a264b51bc0b82b177877ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4a9239d4f444937bf592e11523ab935"
I20260810 04:50:48.543399 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d04017161b1d4b60a30ee4bda7e39d1c" candidate_uuid: "50a492015a264b51bc0b82b177877ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd62211ab0a476ea63318d4584971db"
I20260810 04:50:48.543493 19642 raft_consensus.cc:3037] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:48.543493 19426 raft_consensus.cc:3037] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:48.544611 19426 raft_consensus.cc:2454] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a492015a264b51bc0b82b177877ea8 in term 1.
I20260810 04:50:48.544588 19642 raft_consensus.cc:2454] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a492015a264b51bc0b82b177877ea8 in term 1.
I20260810 04:50:48.544889 19117 leader_election.cc:302] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a492015a264b51bc0b82b177877ea8, abd62211ab0a476ea63318d4584971db; no voters:
I20260810 04:50:48.545028 19903 raft_consensus.cc:2781] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:48.545179 19903 raft_consensus.cc:686] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [term 1 LEADER]: Becoming Leader. State: Replica: 50a492015a264b51bc0b82b177877ea8, State: Running, Role: LEADER
I20260810 04:50:48.545285 19903 consensus_queue.cc:237] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } }
I20260810 04:50:48.546540 18985 catalog_manager.cc:5495] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50a492015a264b51bc0b82b177877ea8 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "50a492015a264b51bc0b82b177877ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a492015a264b51bc0b82b177877ea8" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 } health_report { overall_health: UNKNOWN } } }
I20260810 04:50:48.569980 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.567235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.15.239.193:39285)
0810 04:50:48.567280 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.567283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.567312 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:50:48.567398 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.567399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.567426 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.567514 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:48.567643 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.568244 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.569140 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.569344 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.569409 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.569566 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.569713 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.569780 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.569817 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.569839 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:50:48.575812 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.573218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:39235 (local address 127.15.239.195:35431)
0810 04:50:48.573293 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.573296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.573314 (+ 18us) server_negotiation.cc:407] Connection header received
0810 04:50:48.573339 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.573340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.573356 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.573411 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:48.573546 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.574096 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.574988 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.575223 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.575294 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.575507 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.575552 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.575615 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.575680 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.575709 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:50:48.575839 19951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.573003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35431 (local address 127.15.239.193:39235)
0810 04:50:48.573206 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:48.573219 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:48.573281 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:48.573422 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:48.573423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:48.573425 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:48.573485 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.573486 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.574193 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.574194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.574841 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.574843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.575300 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.575301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.575388 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.575405 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.575618 (+ 213us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.575621 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:50:48.575675 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:50:48.575731 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":92,"threads_started":1}
I20260810 04:50:48.578703 19642 raft_consensus.cc:1261] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Refusing update from remote peer 50a492015a264b51bc0b82b177877ea8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:48.578703 19426 raft_consensus.cc:1261] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Refusing update from remote peer 50a492015a264b51bc0b82b177877ea8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:50:48.579035 19903 consensus_queue.cc:1035] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd62211ab0a476ea63318d4584971db" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:48.579229 19940 consensus_queue.cc:1035] T d04017161b1d4b60a30ee4bda7e39d1c P 50a492015a264b51bc0b82b177877ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a9239d4f444937bf592e11523ab935" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:50:48.587602 19912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.585078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:55247 (local address 127.15.239.193:39285)
0810 04:50:48.585123 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:48.585125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:48.585133 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:50:48.585155 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:48.585156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:48.585174 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:48.585242 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:50:48.585361 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.585894 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.586713 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.587087 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.587154 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.587305 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.587338 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.587383 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:48.587500 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 04:50:48.587525 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:50:48.587625 19929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:48.584888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39285 (local address 127.15.239.195:55247)
0810 04:50:48.584948 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:48.584962 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:48.585002 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:48.585246 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:48.585247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:48.585249 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:50:48.585309 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.585311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.585979 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.585980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.586612 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:48.586615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:48.587164 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:48.587165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:48.587240 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:48.587248 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:50:48.587421 (+ 173us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:50:48.587425 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:50:48.587506 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 04:50:48.587561 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 04:50:48.588183 19845 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 04:50:50.116405 18983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:50.116545 18983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:50:50.117519 18983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 357abae7d9db44aba098e692de9153c3: Sending DeleteTablet for 3 replicas of tablet d04017161b1d4b60a30ee4bda7e39d1c
I20260810 04:50:50.117834 19605 tablet_service.cc:1514] Processing DeleteTablet for tablet d04017161b1d4b60a30ee4bda7e39d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:50 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54922
I20260810 04:50:50.117807 19188 tablet_service.cc:1514] Processing DeleteTablet for tablet d04017161b1d4b60a30ee4bda7e39d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:50 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:54588
I20260810 04:50:50.118021 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 19090
I20260810 04:50:50.118069 19393 tablet_service.cc:1514] Processing DeleteTablet for tablet d04017161b1d4b60a30ee4bda7e39d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:50:50 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:32976
I20260810 04:50:50.126672 19988 tablet_replica.cc:330] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: stopping tablet replica
I20260810 04:50:50.126787 19988 raft_consensus.cc:2229] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:50.126883 19988 raft_consensus.cc:2258] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:50.127082 19990 tablet_replica.cc:330] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: stopping tablet replica
I20260810 04:50:50.127158 19990 raft_consensus.cc:2229] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:50:50.127205 19990 raft_consensus.cc:2258] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:50:50.127242 19988 ts_tablet_manager.cc:1905] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:50.127533 19990 ts_tablet_manager.cc:1905] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:50:50.129426 19988 ts_tablet_manager.cc:1918] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:50:50.129503 19988 log.cc:1196] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/d04017161b1d4b60a30ee4bda7e39d1c
I20260810 04:50:50.129603 19990 ts_tablet_manager.cc:1918] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 04:50:50.129669 19990 log.cc:1196] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/d04017161b1d4b60a30ee4bda7e39d1c
I20260810 04:50:50.129776 19988 ts_tablet_manager.cc:1939] T d04017161b1d4b60a30ee4bda7e39d1c P abd62211ab0a476ea63318d4584971db: Deleting consensus metadata
I20260810 04:50:50.129933 19990 ts_tablet_manager.cc:1939] T d04017161b1d4b60a30ee4bda7e39d1c P b4a9239d4f444937bf592e11523ab935: Deleting consensus metadata
I20260810 04:50:50.130277 18962 catalog_manager.cc:4841] TS abd62211ab0a476ea63318d4584971db (127.15.239.195:35431): tablet d04017161b1d4b60a30ee4bda7e39d1c (table test-table [id=7abe1c0fe8cc41e491c444592d7adf10]) successfully deleted
I20260810 04:50:50.131358 18965 catalog_manager.cc:4841] TS b4a9239d4f444937bf592e11523ab935 (127.15.239.194:33263): tablet d04017161b1d4b60a30ee4bda7e39d1c (table test-table [id=7abe1c0fe8cc41e491c444592d7adf10]) successfully deleted
W20260810 04:50:50.138794 18965 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:39285 (error 108)
I20260810 04:50:50.139618 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 19300
I20260810 04:50:50.139698 19992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:50.139401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39285 (local address 127.0.0.1:54604)
0810 04:50:50.139570 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:50.139625 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
W20260810 04:50:50.142689 18965 catalog_manager.cc:4584] TS 50a492015a264b51bc0b82b177877ea8 (127.15.239.193:39285): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d04017161b1d4b60a30ee4bda7e39d1c: Network error: Client connection negotiation failed: client connection to 127.15.239.193:39285: connect: Connection refused (error 111)
I20260810 04:50:50.159127 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 19503
I20260810 04:50:50.178646 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18938
2026-08-10T04:50:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6714 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:50 dist-test-slave-kvfs krb5kdc[19996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:50 dist-test-slave-kvfs krb5kdc[19996](info): set up 2 sockets
Aug 10 04:50:50 dist-test-slave-kvfs krb5kdc[19996](info): commencing operation
krb5kdc: starting...
W20260810 04:50:51.498586 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:51 dist-test-slave-kvfs krb5kdc[19996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:51.644323 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36675
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:34301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:51.740646 20011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:51.740944 20011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:51.740983 20011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:51.742189 20011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:51.742266 20011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:51.742290 20011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:51.742324 20011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:51.742354 20011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:51.743953 20011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:34301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:51.744289 20011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:51.744568 20011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:50:51.750579 20011 server_base.cc:1034] running on GCE node
W20260810 04:50:51.750558 20019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:51.750558 20017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:51.750542 20016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:51.751166 20011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:51.751564 20011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:51.752772 20011 hybrid_clock.cc:648] HybridClock initialized: now 1786337451752757 us; error 56 us; skew 500 ppm
Aug 10 04:50:51 dist-test-slave-kvfs krb5kdc[19996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337451, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:51.755839 20011 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:51.756451 20011 webserver.cc:460] Webserver started at http://127.15.239.254:44339/ using document root <none> and password file <none>
I20260810 04:50:51.756722 20011 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:51.756796 20011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:51.756968 20011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:51.758311 20011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "430e5b74535d4f1b80abe40963d80255"
format_stamp: "Formatted at 2026-08-10 04:50:51 on dist-test-slave-kvfs"
server_key: "a186f0c5f66e10ecd8ae58549cd15a4b"
server_key_iv: "6b5253284379787de15681be446ff200"
server_key_version: "encryptionkey@0"
I20260810 04:50:51.758762 20011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "430e5b74535d4f1b80abe40963d80255"
format_stamp: "Formatted at 2026-08-10 04:50:51 on dist-test-slave-kvfs"
server_key: "a186f0c5f66e10ecd8ae58549cd15a4b"
server_key_iv: "6b5253284379787de15681be446ff200"
server_key_version: "encryptionkey@0"
I20260810 04:50:51.760375 20011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:50:51.761248 20036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:51.761435 20011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:50:51.761561 20011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "430e5b74535d4f1b80abe40963d80255"
format_stamp: "Formatted at 2026-08-10 04:50:51 on dist-test-slave-kvfs"
server_key: "a186f0c5f66e10ecd8ae58549cd15a4b"
server_key_iv: "6b5253284379787de15681be446ff200"
server_key_version: "encryptionkey@0"
I20260810 04:50:51.761646 20011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:51.770547 20011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:51.772825 20011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:51.773005 20011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:51.778060 20011 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:36675
I20260810 04:50:51.778095 20110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:36675 every 8 connection(s)
I20260810 04:50:51.778559 20011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:51.779635 20112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:51.781363 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 20011
I20260810 04:50:51.781482 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:51.781697 16319 external_mini_cluster.cc:1428] Setting key 8bacdaefdc443ac6f284727eb6fb7061
I20260810 04:50:51.783039 20112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255: Bootstrap starting.
I20260810 04:50:51.783929 20112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:51.784361 20112 log.cc:824] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:51.785226 20112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255: No bootstrap required, opened a new log
I20260810 04:50:51.787859 20112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "430e5b74535d4f1b80abe40963d80255" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36675 } }
I20260810 04:50:51.788132 20112 raft_consensus.cc:374] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:51.788199 20112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 430e5b74535d4f1b80abe40963d80255, State: Initialized, Role: FOLLOWER
I20260810 04:50:51.788358 20112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "430e5b74535d4f1b80abe40963d80255" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36675 } }
I20260810 04:50:51.788436 20112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:51.788460 20112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:51.788537 20112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:51.789173 20112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "430e5b74535d4f1b80abe40963d80255" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36675 } }
I20260810 04:50:51.789275 20112 leader_election.cc:302] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 430e5b74535d4f1b80abe40963d80255; no voters:
I20260810 04:50:51.789537 20112 leader_election.cc:288] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:51.789602 20119 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:51.789816 20119 raft_consensus.cc:686] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [term 1 LEADER]: Becoming Leader. State: Replica: 430e5b74535d4f1b80abe40963d80255, State: Running, Role: LEADER
I20260810 04:50:51.789857 20112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:51.790023 20119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "430e5b74535d4f1b80abe40963d80255" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36675 } }
Aug 10 04:50:51 dist-test-slave-kvfs krb5kdc[19996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:51.790417 20119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 430e5b74535d4f1b80abe40963d80255. Latest consensus state: current_term: 1 leader_uuid: "430e5b74535d4f1b80abe40963d80255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "430e5b74535d4f1b80abe40963d80255" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36675 } } }
I20260810 04:50:51.790470 20120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "430e5b74535d4f1b80abe40963d80255" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "430e5b74535d4f1b80abe40963d80255" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36675 } } }
I20260810 04:50:51.790616 20120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:51.790863 20119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255 [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:51.791065 20131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:51.792028 20131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:51.794195 20131 catalog_manager.cc:1347] Generated new cluster ID: a36db45117654182b0ae06bbcf83f10d
I20260810 04:50:51.794251 20131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:50:51.795493 20117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:51.782394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51018 (local address 127.15.239.254:36675)
0810 04:50:51.782612 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:51.782621 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:51.782652 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:50:51.783196 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:51.783206 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:51.783265 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:51.783400 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:51.784454 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:51.785712 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:51.786873 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:51.787313 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:51.787422 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:51.790750 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:51.790756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:51.790757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:51.790773 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:51.793144 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:51.793564 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:51.793567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:51.793568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:51.793673 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:51.793920 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:51.793921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:51.793922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:51.794293 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:51.794471 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:51.795084 (+ 613us) server_negotiation.cc:299] Negotiation successful
0810 04:50:51.795254 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":116,"threads_started":1}
I20260810 04:50:51.812137 20131 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:51.812928 20131 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:51.822872 20131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 430e5b74535d4f1b80abe40963d80255: Generated new TSK 0
I20260810 04:50:51.823115 20131 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:50:51.859372 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36675
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:34301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:51.959021 20153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:51.959316 20153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:51.959357 20153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:51.960639 20153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:51.960713 20153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:51.960757 20153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:51.962342 20153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:34301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:51.962788 20153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:51.963106 20153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:51.969367 20161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:51.969354 20162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:51.969607 20153 server_base.cc:1034] running on GCE node
W20260810 04:50:51.969357 20165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:51.970014 20153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:51.970304 20153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:51.971472 20153 hybrid_clock.cc:648] HybridClock initialized: now 1786337451971453 us; error 40 us; skew 500 ppm
Aug 10 04:50:51 dist-test-slave-kvfs krb5kdc[19996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337451, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:51.974705 20153 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:51.975224 20153 webserver.cc:460] Webserver started at http://127.15.239.193:45707/ using document root <none> and password file <none>
I20260810 04:50:51.975523 20153 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:51.975596 20153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:51.975764 20153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:51.977092 20153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "e7cb4df8506c46bc9ebc2525402e4e4a"
format_stamp: "Formatted at 2026-08-10 04:50:51 on dist-test-slave-kvfs"
server_key: "2f821dde4f8952eed66f6e550bf79811"
server_key_iv: "c5279c0af5b20b081450dbc40c087151"
server_key_version: "encryptionkey@0"
I20260810 04:50:51.977571 20153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "e7cb4df8506c46bc9ebc2525402e4e4a"
format_stamp: "Formatted at 2026-08-10 04:50:51 on dist-test-slave-kvfs"
server_key: "2f821dde4f8952eed66f6e550bf79811"
server_key_iv: "c5279c0af5b20b081450dbc40c087151"
server_key_version: "encryptionkey@0"
I20260810 04:50:51.979117 20153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:50:51.980079 20175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:51.980283 20153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:51.980404 20153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "e7cb4df8506c46bc9ebc2525402e4e4a"
format_stamp: "Formatted at 2026-08-10 04:50:51 on dist-test-slave-kvfs"
server_key: "2f821dde4f8952eed66f6e550bf79811"
server_key_iv: "c5279c0af5b20b081450dbc40c087151"
server_key_version: "encryptionkey@0"
I20260810 04:50:51.980496 20153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:52.002588 20153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:52.005460 20153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:52.005664 20153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:52.005976 20153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:52.006379 20153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:52.006436 20153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.006484 20153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:52.006508 20153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.013671 20153 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:40801
I20260810 04:50:52.013726 20355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:40801 every 8 connection(s)
I20260810 04:50:52.014132 20153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:52.017974 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 20153
I20260810 04:50:52.018093 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:52.018324 16319 external_mini_cluster.cc:1428] Setting key 05a837f465a378c4fc45447f21ddb23b
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[19996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337451, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:52.026834 20117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:52.015067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:43187 (local address 127.15.239.254:36675)
0810 04:50:52.015157 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:52.015159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:52.015371 (+ 212us) server_negotiation.cc:407] Connection header received
0810 04:50:52.015997 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:52.015998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:52.016012 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:52.016143 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:52.017295 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.017889 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.019460 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.019691 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.019752 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:52.023126 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:52.023128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:52.023129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:52.023142 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:52.025086 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:52.025639 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:52.025641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:52.025642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:52.025725 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:52.025987 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:52.025988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:52.025988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:52.026165 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:52.026243 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:52.026532 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 04:50:52.026677 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:50:52.026851 20358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:52.015002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36675 (local address 127.15.239.193:43187)
0810 04:50:52.015209 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:52.015262 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:52.015865 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:52.016219 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:52.016223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:52.016906 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:52.017169 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:52.017174 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.018048 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.018049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:52.019362 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:52.019367 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.019936 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.019937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:52.020158 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:52.020834 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:52.020849 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:52.023011 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:52.025177 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:52.025184 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:52.025187 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:52.025551 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:52.025796 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:52.025796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:52.025797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:52.025916 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:52.026240 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:52.026246 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:52.026388 (+ 142us) client_negotiation.cc:769] Sending connection context
0810 04:50:52.026477 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 04:50:52.026639 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":117,"threads_started":1}
I20260810 04:50:52.027525 20356 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36675
I20260810 04:50:52.027666 20356 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:52.027891 20356 heartbeater.cc:511] Master 127.15.239.254:36675 requested a full tablet report, sending...
I20260810 04:50:52.028613 20065 ts_manager.cc:194] Registered new tserver with Master: e7cb4df8506c46bc9ebc2525402e4e4a (127.15.239.193:40801)
I20260810 04:50:52.029307 20065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:43187
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:50:52.050597 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36675
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:34301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:52.152648 20363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:52.152995 20363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:52.153040 20363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:52.154361 20363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:52.154448 20363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:52.154495 20363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:50:52.156176 20363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:34301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:52.156515 20363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:52.156816 20363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:52.163199 20371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:52.163327 20363 server_base.cc:1034] running on GCE node
W20260810 04:50:52.163128 20377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:52.163156 20373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:52.163800 20363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:52.164180 20363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:52.165318 20363 hybrid_clock.cc:648] HybridClock initialized: now 1786337452165302 us; error 53 us; skew 500 ppm
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[19996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337452, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:52.168444 20363 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:50:52.168999 20363 webserver.cc:460] Webserver started at http://127.15.239.194:37327/ using document root <none> and password file <none>
I20260810 04:50:52.169301 20363 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:52.169353 20363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:52.169508 20363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:52.170764 20363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "c7d0c518fdf048538b43bae42348d815"
format_stamp: "Formatted at 2026-08-10 04:50:52 on dist-test-slave-kvfs"
server_key: "35dfb27db2744f30cc4f1f45dce20646"
server_key_iv: "0046901b66b4067074e45a57f9fde185"
server_key_version: "encryptionkey@0"
I20260810 04:50:52.171183 20363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "c7d0c518fdf048538b43bae42348d815"
format_stamp: "Formatted at 2026-08-10 04:50:52 on dist-test-slave-kvfs"
server_key: "35dfb27db2744f30cc4f1f45dce20646"
server_key_iv: "0046901b66b4067074e45a57f9fde185"
server_key_version: "encryptionkey@0"
I20260810 04:50:52.172835 20363 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:50:52.173755 20394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.173962 20363 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:52.174091 20363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c7d0c518fdf048538b43bae42348d815"
format_stamp: "Formatted at 2026-08-10 04:50:52 on dist-test-slave-kvfs"
server_key: "35dfb27db2744f30cc4f1f45dce20646"
server_key_iv: "0046901b66b4067074e45a57f9fde185"
server_key_version: "encryptionkey@0"
I20260810 04:50:52.174180 20363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:52.187254 20363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:52.189847 20363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:52.190039 20363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:52.190387 20363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:52.190788 20363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:52.190825 20363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.190851 20363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:52.190864 20363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.198084 20363 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:33439
I20260810 04:50:52.198141 20571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:33439 every 8 connection(s)
I20260810 04:50:52.198556 20363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[19996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337452, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:52.208259 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 20363
I20260810 04:50:52.208359 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:50:52.208657 16319 external_mini_cluster.cc:1428] Setting key 1ff59857985e651ae665356ff6c82c6c
I20260810 04:50:52.209640 20117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:52.199491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:40289 (local address 127.15.239.254:36675)
0810 04:50:52.199595 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:52.199598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:52.199778 (+ 180us) server_negotiation.cc:407] Connection header received
0810 04:50:52.200487 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:52.200489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:52.200503 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:52.200564 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:52.201720 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.202307 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.203428 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.203660 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.203718 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:52.206415 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:52.206417 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:52.206417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:52.206425 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:52.207853 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:52.208429 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:52.208431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:52.208431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:52.208512 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:52.208818 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:52.208819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:52.208819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:52.209034 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:52.209106 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:52.209428 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 04:50:52.209534 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 04:50:52.209882 20576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:52.199420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36675 (local address 127.15.239.194:40289)
0810 04:50:52.199620 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:52.199666 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:52.200353 (+ 687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:52.200637 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:52.200641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:52.201351 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:52.201607 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:52.201612 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.202414 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.202415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:52.203324 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:52.203327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.203741 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.203742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:52.203874 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:52.204616 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:52.204627 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:52.206299 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:52.207938 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:52.207945 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:52.207947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:52.208281 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:52.208586 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:52.208587 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:52.208588 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:52.208710 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:52.209092 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:52.209100 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:52.209266 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 04:50:52.209389 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:50:52.209582 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":122,"threads_started":1}
I20260810 04:50:52.210476 20573 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36675
I20260810 04:50:52.210619 20573 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:52.210873 20573 heartbeater.cc:511] Master 127.15.239.254:36675 requested a full tablet report, sending...
I20260810 04:50:52.211354 20065 ts_manager.cc:194] Registered new tserver with Master: c7d0c518fdf048538b43bae42348d815 (127.15.239.194:33439)
I20260810 04:50:52.211803 20065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:40289
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:50:52.239836 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36675
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:34301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:52.341523 20581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:52.341802 20581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:52.341830 20581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:52.342968 20581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:52.343008 20581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:52.343037 20581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:50:52.344580 20581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:34301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:52.344846 20581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:52.345070 20581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:52.351014 20592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:52.351060 20587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:52.350996 20588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:52.351308 20581 server_base.cc:1034] running on GCE node
I20260810 04:50:52.351645 20581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:52.351960 20581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:52.353160 20581 hybrid_clock.cc:648] HybridClock initialized: now 1786337452353138 us; error 43 us; skew 500 ppm
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[19996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337452, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:52.356305 20581 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:50:52.356828 20581 webserver.cc:460] Webserver started at http://127.15.239.195:37619/ using document root <none> and password file <none>
I20260810 04:50:52.357090 20581 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:52.357162 20581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:52.357329 20581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:52.358563 20581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "6ad55cd7a4db4fb28b0ff4bbdc557a3a"
format_stamp: "Formatted at 2026-08-10 04:50:52 on dist-test-slave-kvfs"
server_key: "fed0d11a1e522049c08bb9eb9fa9e908"
server_key_iv: "9bc6778fd8cbe8072fa0bb3b6160e73c"
server_key_version: "encryptionkey@0"
I20260810 04:50:52.358983 20581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "6ad55cd7a4db4fb28b0ff4bbdc557a3a"
format_stamp: "Formatted at 2026-08-10 04:50:52 on dist-test-slave-kvfs"
server_key: "fed0d11a1e522049c08bb9eb9fa9e908"
server_key_iv: "9bc6778fd8cbe8072fa0bb3b6160e73c"
server_key_version: "encryptionkey@0"
I20260810 04:50:52.360700 20581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:50:52.361557 20601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.361757 20581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:52.361881 20581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "6ad55cd7a4db4fb28b0ff4bbdc557a3a"
format_stamp: "Formatted at 2026-08-10 04:50:52 on dist-test-slave-kvfs"
server_key: "fed0d11a1e522049c08bb9eb9fa9e908"
server_key_iv: "9bc6778fd8cbe8072fa0bb3b6160e73c"
server_key_version: "encryptionkey@0"
I20260810 04:50:52.361966 20581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:52.380419 20581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:52.382979 20581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:52.383209 20581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:52.383524 20581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:52.383917 20581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:52.383975 20581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.384019 20581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:52.384087 20581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:52.391718 20581 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:41615
I20260810 04:50:52.391769 20776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:41615 every 8 connection(s)
I20260810 04:50:52.392257 20581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:50:52.397498 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 20581
I20260810 04:50:52.397598 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:50:52.397846 16319 external_mini_cluster.cc:1428] Setting key d4fafb3034780a63eaa193c1b583c322
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[19996](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337452, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:52.403211 20117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:52.393216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:52047 (local address 127.15.239.254:36675)
0810 04:50:52.393280 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:52.393282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:52.393473 (+ 191us) server_negotiation.cc:407] Connection header received
0810 04:50:52.394090 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:52.394092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:52.394106 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:52.394173 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:52.395312 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.395913 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.397060 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.397303 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.397382 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:52.400293 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:52.400295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:52.400295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:52.400302 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:52.401796 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:52.402227 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:52.402228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:52.402228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:52.402283 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:52.402525 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:52.402526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:52.402526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:52.402644 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:52.402699 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:52.403056 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 04:50:52.403129 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:50:52.403548 20781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:52.393126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36675 (local address 127.15.239.195:52047)
0810 04:50:52.393314 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:52.393365 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:52.393961 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:52.394268 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:52.394272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:52.394975 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:52.395220 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:52.395224 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.396006 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.396007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:52.396971 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:52.396974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:52.397389 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:52.397390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:52.397507 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:52.398261 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:52.398273 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:52.400198 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:52.401888 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:52.401895 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:52.401898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:52.402154 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:52.402353 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:52.402353 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:52.402354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:52.402468 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:52.402730 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:52.402738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:52.402903 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 04:50:52.403034 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 04:50:52.403194 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
I20260810 04:50:52.404132 20777 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36675
I20260810 04:50:52.404268 20777 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:52.404511 20777 heartbeater.cc:511] Master 127.15.239.254:36675 requested a full tablet report, sending...
I20260810 04:50:52.405043 20065 ts_manager.cc:194] Registered new tserver with Master: 6ad55cd7a4db4fb28b0ff4bbdc557a3a (127.15.239.195:41615)
I20260810 04:50:52.405505 20065 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:52047
I20260810 04:50:52.409837 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 04:50:52.426024 20117 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:50:52.424732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.15.239.254:36675)
0810 04:50:52.424830 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:52.424833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:52.424958 (+ 125us) server_negotiation.cc:407] Connection header received
0810 04:50:52.425061 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:52.425063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:52.425083 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:52.425148 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:52.425916 (+ 768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51026: BlockingRecv error: recv got EOF from 127.0.0.1:51026 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:50:52.427124 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 20153
I20260810 04:50:52.444010 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 20363
I20260810 04:50:52.457939 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 20581
I20260810 04:50:52.468611 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 20011
2026-08-10T04:50:52Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2281 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[20795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[20795](info): set up 2 sockets
Aug 10 04:50:52 dist-test-slave-kvfs krb5kdc[20795](info): commencing operation
krb5kdc: starting...
W20260810 04:50:53.758977 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:53 dist-test-slave-kvfs krb5kdc[20795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:53.912220 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:46415
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:46415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:54.010361 20820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:54.010699 20820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:54.010744 20820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:54.012117 20820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:54.012184 20820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:54.012207 20820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:54.012228 20820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:54.012259 20820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:54.013976 20820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:46415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:46415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:54.014312 20820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:54.014603 20820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:54.020576 20826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:54.020592 20825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:54.020848 20820 server_base.cc:1034] running on GCE node
W20260810 04:50:54.020958 20829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:54.021265 20820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:54.021657 20820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:54.022915 20820 hybrid_clock.cc:648] HybridClock initialized: now 1786337454022892 us; error 42 us; skew 500 ppm
Aug 10 04:50:54 dist-test-slave-kvfs krb5kdc[20795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337454, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:54.026387 20820 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:54.026993 20820 webserver.cc:460] Webserver started at http://127.15.239.254:40485/ using document root <none> and password file <none>
I20260810 04:50:54.027279 20820 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:54.027364 20820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:54.027539 20820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:54.028940 20820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "d9f14bd1c94e43e8ab6e50084466ef6d"
format_stamp: "Formatted at 2026-08-10 04:50:54 on dist-test-slave-kvfs"
server_key: "4be03778468dbbb4eb74d8e6c218507c"
server_key_iv: "4bcddd6c4e889e8e50971862d03fd675"
server_key_version: "encryptionkey@0"
I20260810 04:50:54.029381 20820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "d9f14bd1c94e43e8ab6e50084466ef6d"
format_stamp: "Formatted at 2026-08-10 04:50:54 on dist-test-slave-kvfs"
server_key: "4be03778468dbbb4eb74d8e6c218507c"
server_key_iv: "4bcddd6c4e889e8e50971862d03fd675"
server_key_version: "encryptionkey@0"
I20260810 04:50:54.030943 20820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:50:54.031774 20844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:54.031989 20820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:54.032147 20820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "d9f14bd1c94e43e8ab6e50084466ef6d"
format_stamp: "Formatted at 2026-08-10 04:50:54 on dist-test-slave-kvfs"
server_key: "4be03778468dbbb4eb74d8e6c218507c"
server_key_iv: "4bcddd6c4e889e8e50971862d03fd675"
server_key_version: "encryptionkey@0"
I20260810 04:50:54.032234 20820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:54.053911 20820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:54.056766 20820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:54.056977 20820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:54.062165 20820 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:46415
I20260810 04:50:54.062204 20930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:46415 every 8 connection(s)
I20260810 04:50:54.062855 20820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:54.063714 20932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:54.066817 20932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d: Bootstrap starting.
I20260810 04:50:54.067600 20932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:54.067967 20932 log.cc:824] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:54.068874 20932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d: No bootstrap required, opened a new log
I20260810 04:50:54.069913 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 20820
I20260810 04:50:54.070037 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:54.070251 16319 external_mini_cluster.cc:1428] Setting key 61ca1d526ca7919ec15ef2cce8327a56
I20260810 04:50:54.071919 20932 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46415 } }
I20260810 04:50:54.072170 20932 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:54.072254 20932 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9f14bd1c94e43e8ab6e50084466ef6d, State: Initialized, Role: FOLLOWER
I20260810 04:50:54.072466 20932 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46415 } }
I20260810 04:50:54.072580 20932 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:54.072618 20932 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:54.072675 20932 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:54.073491 20932 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46415 } }
I20260810 04:50:54.073625 20932 leader_election.cc:302] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9f14bd1c94e43e8ab6e50084466ef6d; no voters:
I20260810 04:50:54.073830 20932 leader_election.cc:288] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:54.073894 20939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:54.074090 20939 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [term 1 LEADER]: Becoming Leader. State: Replica: d9f14bd1c94e43e8ab6e50084466ef6d, State: Running, Role: LEADER
I20260810 04:50:54.074153 20932 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:54.074244 20939 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46415 } }
I20260810 04:50:54.074786 20940 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46415 } } }
I20260810 04:50:54.074877 20940 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:54.075151 20941 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9f14bd1c94e43e8ab6e50084466ef6d. Latest consensus state: current_term: 1 leader_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9f14bd1c94e43e8ab6e50084466ef6d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46415 } } }
I20260810 04:50:54.075271 20941 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:54.075485 20950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:54.076238 20950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:54.079609 20950 catalog_manager.cc:1347] Generated new cluster ID: b261cc6b89794ccdafca197541f7a331
I20260810 04:50:54.079731 20950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:50:54 dist-test-slave-kvfs krb5kdc[20795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:54.085525 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:54.070925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34196 (local address 127.15.239.254:46415)
0810 04:50:54.071145 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:54.071155 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:54.071187 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:50:54.071912 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:54.071922 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:54.071988 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:54.072225 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:54.073139 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:54.074522 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:54.075774 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:54.076465 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:54.076600 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:54.081146 (+ 4546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:54.081178 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:54.081178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:54.081195 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:54.083537 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:54.083980 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:54.083985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:54.083986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:54.084194 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:54.084423 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:54.084424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:54.084425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:54.084825 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:54.085004 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:54.085095 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 04:50:54.085261 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260810 04:50:54.086609 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:50:54.090094 20950 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:54.090613 20950 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:54.093770 20950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9f14bd1c94e43e8ab6e50084466ef6d: Generated new TSK 0
I20260810 04:50:54.094003 20950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:50:54.109076 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:54.104478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34204 (local address 127.15.239.254:46415)
0810 04:50:54.104558 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:54.104562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:54.104740 (+ 178us) server_negotiation.cc:407] Connection header received
0810 04:50:54.104849 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:54.104850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:54.104880 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:54.104939 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:54.105498 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:54.106092 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:54.107262 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:54.107518 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:54.107577 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:54.108482 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:54.108483 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:54.108484 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:50:54.108756 (+ 272us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:54.108777 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:50:54.108785 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:54.108857 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:54.108927 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 04:50:54.108959 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:50:54.112447 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 20820
2026-08-10T04:50:54Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1648 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:54 dist-test-slave-kvfs krb5kdc[20980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:54 dist-test-slave-kvfs krb5kdc[20980](info): set up 2 sockets
Aug 10 04:50:54 dist-test-slave-kvfs krb5kdc[20980](info): commencing operation
krb5kdc: starting...
W20260810 04:50:55.456532 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:55 dist-test-slave-kvfs krb5kdc[20980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:55.616940 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35455
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:35455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:55.714520 21002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:55.714838 21002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:55.714880 21002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:55.716169 21002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:55.716244 21002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:55.716270 21002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:55.716291 21002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:55.716327 21002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:55.717974 21002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:35455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:55.718314 21002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:55.718606 21002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:55.724519 21010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:55.724521 21013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:55.724520 21009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:55.724773 21002 server_base.cc:1034] running on GCE node
I20260810 04:50:55.725175 21002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:55.725585 21002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:55.726878 21002 hybrid_clock.cc:648] HybridClock initialized: now 1786337455726859 us; error 53 us; skew 500 ppm
Aug 10 04:50:55 dist-test-slave-kvfs krb5kdc[20980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337455, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:55.733863 21002 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:55.734454 21002 webserver.cc:460] Webserver started at http://127.15.239.254:36985/ using document root <none> and password file <none>
I20260810 04:50:55.734767 21002 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:55.734844 21002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:55.735026 21002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:55.736390 21002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "ac7d15062a3c40f6986163b5a205cb4b"
format_stamp: "Formatted at 2026-08-10 04:50:55 on dist-test-slave-kvfs"
server_key: "e578eb94a0cc1700a7a946248655e8bb"
server_key_iv: "d8c3eee2d2a38476cca3f4e01dcc8ba7"
server_key_version: "encryptionkey@0"
I20260810 04:50:55.736814 21002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "ac7d15062a3c40f6986163b5a205cb4b"
format_stamp: "Formatted at 2026-08-10 04:50:55 on dist-test-slave-kvfs"
server_key: "e578eb94a0cc1700a7a946248655e8bb"
server_key_iv: "d8c3eee2d2a38476cca3f4e01dcc8ba7"
server_key_version: "encryptionkey@0"
I20260810 04:50:55.738411 21002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:50:55.739424 21024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:55.739692 21002 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:55.739822 21002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "ac7d15062a3c40f6986163b5a205cb4b"
format_stamp: "Formatted at 2026-08-10 04:50:55 on dist-test-slave-kvfs"
server_key: "e578eb94a0cc1700a7a946248655e8bb"
server_key_iv: "d8c3eee2d2a38476cca3f4e01dcc8ba7"
server_key_version: "encryptionkey@0"
I20260810 04:50:55.739908 21002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:55.757089 21002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:55.759873 21002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:55.760118 21002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:55.765300 21002 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:35455
I20260810 04:50:55.765339 21106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:35455 every 8 connection(s)
I20260810 04:50:55.765813 21002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:55.767204 21107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:55.770411 21107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b: Bootstrap starting.
I20260810 04:50:55.771198 21107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:55.771575 21107 log.cc:824] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:55.772528 21107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b: No bootstrap required, opened a new log
I20260810 04:50:55.774580 21107 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7d15062a3c40f6986163b5a205cb4b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35455 } }
I20260810 04:50:55.774766 21107 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:55.774793 21107 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7d15062a3c40f6986163b5a205cb4b, State: Initialized, Role: FOLLOWER
I20260810 04:50:55.775050 21107 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7d15062a3c40f6986163b5a205cb4b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35455 } }
I20260810 04:50:55.775187 21107 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:55.775235 21107 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:55.775298 21107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:55.775449 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 21002
I20260810 04:50:55.775586 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:55.775799 16319 external_mini_cluster.cc:1428] Setting key cf52c1be8ae63d2a8d836c0eac7fc291
I20260810 04:50:55.776773 21107 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7d15062a3c40f6986163b5a205cb4b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35455 } }
I20260810 04:50:55.776921 21107 leader_election.cc:302] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac7d15062a3c40f6986163b5a205cb4b; no voters:
I20260810 04:50:55.777146 21107 leader_election.cc:288] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:55.777199 21116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:55.777503 21116 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [term 1 LEADER]: Becoming Leader. State: Replica: ac7d15062a3c40f6986163b5a205cb4b, State: Running, Role: LEADER
I20260810 04:50:55.777513 21107 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:55.778254 21116 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7d15062a3c40f6986163b5a205cb4b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35455 } }
I20260810 04:50:55.779079 21117 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac7d15062a3c40f6986163b5a205cb4b. Latest consensus state: current_term: 1 leader_uuid: "ac7d15062a3c40f6986163b5a205cb4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7d15062a3c40f6986163b5a205cb4b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35455 } } }
I20260810 04:50:55.779265 21118 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac7d15062a3c40f6986163b5a205cb4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7d15062a3c40f6986163b5a205cb4b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35455 } } }
I20260810 04:50:55.779510 21117 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:55.779520 21118 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b [sys.catalog]: This master's current role is: LEADER
W20260810 04:50:55.779896 21136 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:50:55.780002 21136 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:50:55.780537 21138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:55.780781 21138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:50:55.782646 21138 catalog_manager.cc:1347] Generated new cluster ID: ddfe0f395a7d41879c8816070a46560b
I20260810 04:50:55.782713 21138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:50:55.787385 21138 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:55.788365 21138 catalog_manager.cc:1504] Loading token signing keys...
Aug 10 04:50:55 dist-test-slave-kvfs krb5kdc[20980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:55.794611 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:55.776497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51938 (local address 127.15.239.254:35455)
0810 04:50:55.776728 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:55.776742 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:55.776787 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:50:55.776957 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:55.776965 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:55.777050 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:55.777272 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:55.778275 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:55.779981 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:55.781197 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:55.781855 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:55.781978 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:55.789886 (+ 7908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:55.789892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:55.789892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:55.789910 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:55.792530 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:55.793070 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:55.793074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:55.793074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:55.793208 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:55.793447 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:55.793448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:55.793448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:55.793801 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:55.793978 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:55.794105 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:50:55.794291 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":111,"threads_started":1}
I20260810 04:50:55.801126 21138 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac7d15062a3c40f6986163b5a205cb4b: Generated new TSK 0
I20260810 04:50:55.801414 21138 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:50:55.842965 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35455
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:55.943778 21147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:55.944155 21147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:55.944191 21147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:55.945590 21147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:55.945647 21147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:55.945677 21147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:55.947405 21147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:55.947757 21147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:55.948158 21147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:55.954444 21163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:55.954455 21156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:55.954455 21159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:55.954828 21147 server_base.cc:1034] running on GCE node
I20260810 04:50:55.955097 21147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:55.955401 21147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:55.956583 21147 hybrid_clock.cc:648] HybridClock initialized: now 1786337455956563 us; error 49 us; skew 500 ppm
Aug 10 04:50:55 dist-test-slave-kvfs krb5kdc[20980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337455, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:55.959754 21147 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:55.960340 21147 webserver.cc:460] Webserver started at http://127.15.239.193:35861/ using document root <none> and password file <none>
I20260810 04:50:55.960582 21147 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:55.960631 21147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:55.960749 21147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:55.962080 21147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "e71fc83e910146feb3191c26fdb259aa"
format_stamp: "Formatted at 2026-08-10 04:50:55 on dist-test-slave-kvfs"
server_key: "4865d6c7f32f194a132f4b61ec5a3f3d"
server_key_iv: "f38e40195342d9b290a57dd26dccd5e3"
server_key_version: "encryptionkey@0"
I20260810 04:50:55.962456 21147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "e71fc83e910146feb3191c26fdb259aa"
format_stamp: "Formatted at 2026-08-10 04:50:55 on dist-test-slave-kvfs"
server_key: "4865d6c7f32f194a132f4b61ec5a3f3d"
server_key_iv: "f38e40195342d9b290a57dd26dccd5e3"
server_key_version: "encryptionkey@0"
I20260810 04:50:55.963981 21147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:50:55.964924 21175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:55.965188 21147 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:55.965309 21147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "e71fc83e910146feb3191c26fdb259aa"
format_stamp: "Formatted at 2026-08-10 04:50:55 on dist-test-slave-kvfs"
server_key: "4865d6c7f32f194a132f4b61ec5a3f3d"
server_key_iv: "f38e40195342d9b290a57dd26dccd5e3"
server_key_version: "encryptionkey@0"
I20260810 04:50:55.965396 21147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:55.985610 21147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:55.988562 21147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:55.988762 21147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:55.989087 21147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:55.989490 21147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:55.989526 21147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:55.989554 21147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:55.989596 21147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:55.996799 21147 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:45453
I20260810 04:50:55.996901 21354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:45453 every 8 connection(s)
I20260810 04:50:55.997290 21147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:56.002149 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 21147
I20260810 04:50:56.002272 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:56.002507 16319 external_mini_cluster.cc:1428] Setting key 624ffcedd90533603905614bc6701517
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337455, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:56.009555 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:55.998340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:40115 (local address 127.15.239.254:35455)
0810 04:50:55.998416 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:55.998418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:55.998692 (+ 274us) server_negotiation.cc:407] Connection header received
0810 04:50:55.999285 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:55.999286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:55.999302 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:55.999389 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:56.000569 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.001166 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.002683 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.002964 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.003073 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.005918 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:56.005920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:56.005920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:56.005929 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:56.007709 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.008310 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.008311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.008312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.008392 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.008698 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.008699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.008699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.008863 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:56.008954 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:56.009303 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 04:50:56.009438 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:50:56.009780 21360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:55.998314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:35455 (local address 127.15.239.193:40115)
0810 04:50:55.998513 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:55.998564 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:55.999175 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:55.999459 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:55.999463 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:56.000172 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:56.000427 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:56.000433 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.001279 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.001280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:56.002542 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:56.002547 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.003083 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.003084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:56.003260 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.003967 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:56.003977 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:56.005774 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:56.007828 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:56.007838 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:56.007842 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:56.008207 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:56.008470 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:56.008471 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:56.008472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:56.008614 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:56.008941 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:56.008950 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:56.009135 (+ 185us) client_negotiation.cc:769] Sending connection context
0810 04:50:56.009260 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 04:50:56.009472 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
I20260810 04:50:56.010452 21358 heartbeater.cc:347] Connected to a master server at 127.15.239.254:35455
I20260810 04:50:56.010600 21358 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:56.010879 21358 heartbeater.cc:511] Master 127.15.239.254:35455 requested a full tablet report, sending...
I20260810 04:50:56.011566 21056 ts_manager.cc:194] Registered new tserver with Master: e71fc83e910146feb3191c26fdb259aa (127.15.239.193:45453)
I20260810 04:50:56.012414 21056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:40115
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:50:56.039340 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35455
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:56.147295 21365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:56.147593 21365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:56.147624 21365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:56.149017 21365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:56.149058 21365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:56.149085 21365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:50:56.150640 21365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:56.150883 21365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:56.151108 21365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:56.156756 21373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:56.156785 21374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:56.156797 21377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:56.157410 21365 server_base.cc:1034] running on GCE node
I20260810 04:50:56.157696 21365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:56.158025 21365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:56.159224 21365 hybrid_clock.cc:648] HybridClock initialized: now 1786337456159201 us; error 41 us; skew 500 ppm
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337456, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:56.162513 21365 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:50:56.163064 21365 webserver.cc:460] Webserver started at http://127.15.239.194:39505/ using document root <none> and password file <none>
I20260810 04:50:56.163385 21365 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:56.163465 21365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:56.163635 21365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:56.164944 21365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "f65ea7cbfb57447cb08f06e0bb693dfe"
format_stamp: "Formatted at 2026-08-10 04:50:56 on dist-test-slave-kvfs"
server_key: "7204b21372d5d9fa5a2fa9e4a668a126"
server_key_iv: "b1abc0f91cff7900a8de92b081ebd63a"
server_key_version: "encryptionkey@0"
I20260810 04:50:56.165365 21365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "f65ea7cbfb57447cb08f06e0bb693dfe"
format_stamp: "Formatted at 2026-08-10 04:50:56 on dist-test-slave-kvfs"
server_key: "7204b21372d5d9fa5a2fa9e4a668a126"
server_key_iv: "b1abc0f91cff7900a8de92b081ebd63a"
server_key_version: "encryptionkey@0"
I20260810 04:50:56.166988 21365 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:50:56.167968 21391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:56.168232 21365 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:56.168394 21365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "f65ea7cbfb57447cb08f06e0bb693dfe"
format_stamp: "Formatted at 2026-08-10 04:50:56 on dist-test-slave-kvfs"
server_key: "7204b21372d5d9fa5a2fa9e4a668a126"
server_key_iv: "b1abc0f91cff7900a8de92b081ebd63a"
server_key_version: "encryptionkey@0"
I20260810 04:50:56.168486 21365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:56.193570 21365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:56.196200 21365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:56.196401 21365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:56.196717 21365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:56.197124 21365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:56.197182 21365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:56.197228 21365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:56.197257 21365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:56.204139 21365 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:45665
I20260810 04:50:56.204193 21565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:45665 every 8 connection(s)
I20260810 04:50:56.204600 21365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:50:56.208143 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 21365
I20260810 04:50:56.208293 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:50:56.208520 16319 external_mini_cluster.cc:1428] Setting key 582e983958fff3d0700583ce8c428b0c
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337456, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:56.216738 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:56.205505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:45335 (local address 127.15.239.254:35455)
0810 04:50:56.205577 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:56.205579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:56.205833 (+ 254us) server_negotiation.cc:407] Connection header received
0810 04:50:56.206496 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:56.206498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:56.206514 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:56.206585 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:56.207736 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.208467 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.209955 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.210183 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.210271 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.213204 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:56.213206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:56.213207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:56.213215 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:56.214885 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.215465 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.215466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.215467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.215534 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.215878 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.215879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.215879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.216079 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:56.216154 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:56.216559 (+ 405us) server_negotiation.cc:299] Negotiation successful
0810 04:50:56.216652 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:50:56.217123 21568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:56.205468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:35455 (local address 127.15.239.194:45335)
0810 04:50:56.205686 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:56.205731 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:56.206373 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:56.206676 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:56.206681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:56.207356 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:56.207619 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:56.207624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.208571 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.208572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:56.209855 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:56.209857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.210280 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.210281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:56.210458 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.211106 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:56.211117 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:56.213087 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:56.214980 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:56.214989 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:56.214992 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:56.215376 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:56.215607 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:56.215608 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:56.215609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:56.215769 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:56.216150 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:56.216159 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:56.216387 (+ 228us) client_negotiation.cc:769] Sending connection context
0810 04:50:56.216537 (+ 150us) client_negotiation.cc:240] Negotiation successful
0810 04:50:56.216775 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":107,"threads_started":1}
I20260810 04:50:56.217789 21566 heartbeater.cc:347] Connected to a master server at 127.15.239.254:35455
I20260810 04:50:56.217924 21566 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:56.218147 21566 heartbeater.cc:511] Master 127.15.239.254:35455 requested a full tablet report, sending...
I20260810 04:50:56.218668 21056 ts_manager.cc:194] Registered new tserver with Master: f65ea7cbfb57447cb08f06e0bb693dfe (127.15.239.194:45665)
I20260810 04:50:56.219141 21056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:45335
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:50:56.244874 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35455
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:56.346453 21571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:56.346760 21571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:56.346803 21571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:56.348120 21571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:56.348192 21571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:56.348241 21571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:50:56.349884 21571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:56.350217 21571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:56.350556 21571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:56.356706 21580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:56.356707 21571 server_base.cc:1034] running on GCE node
W20260810 04:50:56.356707 21578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:56.356786 21583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:56.357156 21571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:56.357496 21571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:56.358691 21571 hybrid_clock.cc:648] HybridClock initialized: now 1786337456358668 us; error 37 us; skew 500 ppm
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337456, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:56.362223 21571 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:50:56.362808 21571 webserver.cc:460] Webserver started at http://127.15.239.195:39379/ using document root <none> and password file <none>
I20260810 04:50:56.363121 21571 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:56.363197 21571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:56.363389 21571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:56.364730 21571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "499707d225b14deb90896793b6cced48"
format_stamp: "Formatted at 2026-08-10 04:50:56 on dist-test-slave-kvfs"
server_key: "2a58b8210bc256a72e3b95fa9ace4e16"
server_key_iv: "0130872d783f12934dd4b7bb34823698"
server_key_version: "encryptionkey@0"
I20260810 04:50:56.365151 21571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "499707d225b14deb90896793b6cced48"
format_stamp: "Formatted at 2026-08-10 04:50:56 on dist-test-slave-kvfs"
server_key: "2a58b8210bc256a72e3b95fa9ace4e16"
server_key_iv: "0130872d783f12934dd4b7bb34823698"
server_key_version: "encryptionkey@0"
I20260810 04:50:56.366734 21571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:50:56.367619 21594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:56.367880 21571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:56.368057 21571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "499707d225b14deb90896793b6cced48"
format_stamp: "Formatted at 2026-08-10 04:50:56 on dist-test-slave-kvfs"
server_key: "2a58b8210bc256a72e3b95fa9ace4e16"
server_key_iv: "0130872d783f12934dd4b7bb34823698"
server_key_version: "encryptionkey@0"
I20260810 04:50:56.368160 21571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:56.379462 21571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:56.382121 21571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:56.382330 21571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:56.382684 21571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:56.383103 21571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:56.383164 21571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:56.383211 21571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:56.383239 21571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:56.390638 21571 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:43161
I20260810 04:50:56.390690 21776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:43161 every 8 connection(s)
I20260810 04:50:56.391108 21571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:50:56.392968 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 21571
I20260810 04:50:56.393083 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:50:56.393290 16319 external_mini_cluster.cc:1428] Setting key 0072920b21e87c8d0411bfd0b0e4643c
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337456, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:56.403432 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:56.392124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:50257 (local address 127.15.239.254:35455)
0810 04:50:56.392232 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:56.392235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:56.392574 (+ 339us) server_negotiation.cc:407] Connection header received
0810 04:50:56.393417 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:56.393419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:56.393438 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:56.393517 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:56.395027 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.395595 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.396836 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.397062 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.397135 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.399890 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:56.399892 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:56.399893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:56.399902 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:56.401749 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.402229 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.402230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.402231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.402299 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.402631 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.402632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.402633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.402782 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:56.402867 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:56.403236 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 04:50:56.403340 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 04:50:56.403652 21779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:56.392082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:35455 (local address 127.15.239.195:50257)
0810 04:50:56.392333 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:56.392391 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:56.393251 (+ 860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:56.393620 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:56.393626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:56.394624 (+ 998us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:56.394924 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:56.394930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.395683 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.395684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:56.396705 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:56.396708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.397192 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.397193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:56.397349 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.398008 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:56.398019 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:56.399752 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:56.401841 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:56.401849 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:56.401852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:56.402144 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:56.402393 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:56.402394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:56.402395 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:56.402537 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:56.402876 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:56.402883 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:56.403067 (+ 184us) client_negotiation.cc:769] Sending connection context
0810 04:50:56.403181 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 04:50:56.403346 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":121,"threads_started":1}
I20260810 04:50:56.404299 21777 heartbeater.cc:347] Connected to a master server at 127.15.239.254:35455
I20260810 04:50:56.404454 21777 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:56.404729 21777 heartbeater.cc:511] Master 127.15.239.254:35455 requested a full tablet report, sending...
I20260810 04:50:56.405296 21056 ts_manager.cc:194] Registered new tserver with Master: 499707d225b14deb90896793b6cced48 (127.15.239.195:43161)
I20260810 04:50:56.405608 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:50:56.405850 21056 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:50257
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337456, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[20980](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337456, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:56.433650 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:56.425475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51954 (local address 127.15.239.254:35455)
0810 04:50:56.425557 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:56.425560 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:56.425684 (+ 124us) server_negotiation.cc:407] Connection header received
0810 04:50:56.425748 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:56.425749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:56.425762 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:56.425817 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:56.426449 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.427018 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.427832 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:56.428105 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:56.428168 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:56.430707 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:56.430709 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:56.430709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:56.430718 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:56.432325 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.432706 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.432708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.432708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.432771 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:56.432973 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:56.432974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:56.432974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:56.433167 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:56.433264 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:56.433419 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 04:50:56.433514 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 04:50:56.433977 21056 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51954
I20260810 04:50:56.434528 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 21147
I20260810 04:50:56.447518 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 21365
I20260810 04:50:56.466686 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 21571
I20260810 04:50:56.484939 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 21002
2026-08-10T04:50:56Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2374 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[21800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[21800](info): set up 2 sockets
Aug 10 04:50:56 dist-test-slave-kvfs krb5kdc[21800](info): commencing operation
krb5kdc: starting...
W20260810 04:50:57.821406 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:50:57 dist-test-slave-kvfs krb5kdc[21800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:50:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:50:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:50:57.972162 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41637
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:41637
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:58.072041 21821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:58.072393 21821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:58.072438 21821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:58.073691 21821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:50:58.073814 21821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:58.073844 21821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:58.073869 21821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:50:58.073904 21821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:50:58.075587 21821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:41637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:58.075925 21821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:58.076246 21821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:58.082424 21829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:58.082414 21840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:58.082414 21833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:58.082458 21821 server_base.cc:1034] running on GCE node
I20260810 04:50:58.083060 21821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:58.083475 21821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:58.084640 21821 hybrid_clock.cc:648] HybridClock initialized: now 1786337458084614 us; error 37 us; skew 500 ppm
Aug 10 04:50:58 dist-test-slave-kvfs krb5kdc[21800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337458, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:58.087832 21821 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:50:58.088469 21821 webserver.cc:460] Webserver started at http://127.15.239.254:34833/ using document root <none> and password file <none>
I20260810 04:50:58.088745 21821 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:58.088820 21821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:58.088989 21821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:58.090279 21821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "0ec9233423fd4ca58360e09de8aba0ed"
format_stamp: "Formatted at 2026-08-10 04:50:58 on dist-test-slave-kvfs"
server_key: "f94a55ae7c7dc631b5b8d783543dd83d"
server_key_iv: "94d9ad238dc87bfd9197e8f1391fcbc1"
server_key_version: "encryptionkey@0"
I20260810 04:50:58.090711 21821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "0ec9233423fd4ca58360e09de8aba0ed"
format_stamp: "Formatted at 2026-08-10 04:50:58 on dist-test-slave-kvfs"
server_key: "f94a55ae7c7dc631b5b8d783543dd83d"
server_key_iv: "94d9ad238dc87bfd9197e8f1391fcbc1"
server_key_version: "encryptionkey@0"
I20260810 04:50:58.092367 21821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:50:58.093269 21851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:58.093489 21821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:58.093631 21821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "0ec9233423fd4ca58360e09de8aba0ed"
format_stamp: "Formatted at 2026-08-10 04:50:58 on dist-test-slave-kvfs"
server_key: "f94a55ae7c7dc631b5b8d783543dd83d"
server_key_iv: "94d9ad238dc87bfd9197e8f1391fcbc1"
server_key_version: "encryptionkey@0"
I20260810 04:50:58.093719 21821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:58.116393 21821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:58.118765 21821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:58.118988 21821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:58.124238 21821 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:41637
I20260810 04:50:58.124295 21935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:41637 every 8 connection(s)
I20260810 04:50:58.124950 21821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:50:58.125857 21938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:50:58.128813 21938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed: Bootstrap starting.
I20260810 04:50:58.129513 21938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed: Neither blocks nor log segments found. Creating new log.
I20260810 04:50:58.129819 21938 log.cc:824] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed: Log is configured to *not* fsync() on all Append() calls
I20260810 04:50:58.130350 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 21821
I20260810 04:50:58.130502 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:50:58.130729 16319 external_mini_cluster.cc:1428] Setting key d3607f845657ec1b9f92fda97e17f217
I20260810 04:50:58.130774 21938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed: No bootstrap required, opened a new log
I20260810 04:50:58.134099 21938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec9233423fd4ca58360e09de8aba0ed" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41637 } }
I20260810 04:50:58.134323 21938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:50:58.134363 21938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec9233423fd4ca58360e09de8aba0ed, State: Initialized, Role: FOLLOWER
I20260810 04:50:58.134506 21938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec9233423fd4ca58360e09de8aba0ed" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41637 } }
I20260810 04:50:58.134598 21938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:50:58.134631 21938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:50:58.134673 21938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:50:58.135511 21938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec9233423fd4ca58360e09de8aba0ed" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41637 } }
I20260810 04:50:58.135676 21938 leader_election.cc:302] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ec9233423fd4ca58360e09de8aba0ed; no voters:
I20260810 04:50:58.135927 21938 leader_election.cc:288] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:50:58.135954 21950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:50:58.136233 21950 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [term 1 LEADER]: Becoming Leader. State: Replica: 0ec9233423fd4ca58360e09de8aba0ed, State: Running, Role: LEADER
I20260810 04:50:58.136382 21950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec9233423fd4ca58360e09de8aba0ed" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41637 } }
I20260810 04:50:58.136427 21938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:50:58.136783 21950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ec9233423fd4ca58360e09de8aba0ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec9233423fd4ca58360e09de8aba0ed" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41637 } } }
I20260810 04:50:58.136965 21950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:58.137213 21950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ec9233423fd4ca58360e09de8aba0ed. Latest consensus state: current_term: 1 leader_uuid: "0ec9233423fd4ca58360e09de8aba0ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ec9233423fd4ca58360e09de8aba0ed" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41637 } } }
I20260810 04:50:58.137352 21950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed [sys.catalog]: This master's current role is: LEADER
I20260810 04:50:58.137802 21965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:50:58.138538 21965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 04:50:58 dist-test-slave-kvfs krb5kdc[21800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:58.140661 21965 catalog_manager.cc:1347] Generated new cluster ID: 7cbf4e8efdce4ea6b697095bffeffacc
I20260810 04:50:58.140717 21965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:50:58.145955 21949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:58.131378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.15.239.254:41637)
0810 04:50:58.131616 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:58.131631 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:58.131676 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:50:58.132528 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:58.132540 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:58.132619 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:58.132810 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:58.133596 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:58.135106 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:58.136273 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:58.136985 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:58.137117 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:58.140953 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:58.140959 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:58.140960 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:58.140977 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:58.143418 (+ 2441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:58.143929 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:58.143933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:58.143934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:58.144090 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:58.144377 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:58.144378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:58.144378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:58.144752 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:58.144946 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:58.145518 (+ 572us) server_negotiation.cc:299] Negotiation successful
0810 04:50:58.145694 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":107,"threads_started":1}
I20260810 04:50:58.160099 21965 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:50:58.161044 21965 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:50:58.166556 21965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ec9233423fd4ca58360e09de8aba0ed: Generated new TSK 0
I20260810 04:50:58.166824 21965 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
W20260810 04:50:58.950420 16319 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.15.239.193: real 0.775s user 0.000s sys 0.005s
I20260810 04:50:58.950842 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41637
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:50:59.050187 21991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:50:59.050469 21991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:50:59.050496 21991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:50:59.051687 21991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:50:59.051728 21991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:50:59.051755 21991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:50:59.053460 21991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:50:59.053692 21991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:50:59.053931 21991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:50:59.059785 22001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:59.059809 21999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:50:59.059818 22003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:50:59.060174 21991 server_base.cc:1034] running on GCE node
I20260810 04:50:59.060494 21991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:50:59.060788 21991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:50:59.062024 21991 hybrid_clock.cc:648] HybridClock initialized: now 1786337459061993 us; error 44 us; skew 500 ppm
Aug 10 04:50:59 dist-test-slave-kvfs krb5kdc[21800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337459, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:50:59.065320 21991 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:50:59.065834 21991 webserver.cc:460] Webserver started at http://127.15.239.193:41645/ using document root <none> and password file <none>
I20260810 04:50:59.066062 21991 fs_manager.cc:359] Metadata directory not provided
I20260810 04:50:59.066108 21991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:50:59.066215 21991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:50:59.067471 21991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "45247bf218e24ad1863cd3b5f3dc04c9"
format_stamp: "Formatted at 2026-08-10 04:50:59 on dist-test-slave-kvfs"
server_key: "c4dc7edfa6e0dfc73cdcd55240eda50b"
server_key_iv: "14331da4d1c533a7c9f1c563b9bb5adb"
server_key_version: "encryptionkey@0"
I20260810 04:50:59.067874 21991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "45247bf218e24ad1863cd3b5f3dc04c9"
format_stamp: "Formatted at 2026-08-10 04:50:59 on dist-test-slave-kvfs"
server_key: "c4dc7edfa6e0dfc73cdcd55240eda50b"
server_key_iv: "14331da4d1c533a7c9f1c563b9bb5adb"
server_key_version: "encryptionkey@0"
I20260810 04:50:59.069443 21991 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:59.070329 22013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:59.070573 21991 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:50:59.070688 21991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "45247bf218e24ad1863cd3b5f3dc04c9"
format_stamp: "Formatted at 2026-08-10 04:50:59 on dist-test-slave-kvfs"
server_key: "c4dc7edfa6e0dfc73cdcd55240eda50b"
server_key_iv: "14331da4d1c533a7c9f1c563b9bb5adb"
server_key_version: "encryptionkey@0"
I20260810 04:50:59.070770 21991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:50:59.103219 21991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:50:59.106377 21991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:50:59.106529 21991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:50:59.106771 21991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:50:59.107121 21991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:50:59.107156 21991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:59.107183 21991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:50:59.107196 21991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:50:59.114507 21991 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:37733
I20260810 04:50:59.114598 22188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:37733 every 8 connection(s)
I20260810 04:50:59.114928 21991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:50:59.119059 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 21991
I20260810 04:50:59.119160 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:50:59.119328 16319 external_mini_cluster.cc:1428] Setting key eef654f58ccaf5ed16f6ff786ac78f21
Aug 10 04:50:59 dist-test-slave-kvfs krb5kdc[21800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337459, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:50:59.127961 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:59.115880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:57231 (local address 127.15.239.254:41637)
0810 04:50:59.116090 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 04:50:59.116093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:50:59.116272 (+ 179us) server_negotiation.cc:407] Connection header received
0810 04:50:59.117480 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:50:59.117481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:50:59.117500 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:50:59.117582 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:50:59.118436 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:59.119945 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:59.121174 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:50:59.121552 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:50:59.121638 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:59.124408 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:50:59.124409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:50:59.124412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:50:59.124426 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:50:59.126152 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:59.126700 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:59.126701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:59.126702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:59.126793 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:50:59.127153 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:50:59.127154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:50:59.127155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:50:59.127316 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:50:59.127396 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:50:59.127742 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 04:50:59.127850 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":88,"threads_started":1}
I20260810 04:50:59.128232 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:50:59.115810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41637 (local address 127.15.239.193:57231)
0810 04:50:59.116102 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0810 04:50:59.116163 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 04:50:59.117320 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:50:59.117673 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:50:59.117678 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:50:59.118013 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:50:59.118311 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:59.118316 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:59.120093 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:59.120095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:59.121086 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:50:59.121089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:50:59.121652 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:50:59.121653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:50:59.121782 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:50:59.122466 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:50:59.122477 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:50:59.124277 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:50:59.126285 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:59.126295 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:59.126298 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:59.126606 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:59.126911 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:50:59.126912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:50:59.126913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:50:59.127069 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:50:59.127396 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:50:59.127406 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:50:59.127588 (+ 182us) client_negotiation.cc:769] Sending connection context
0810 04:50:59.127706 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:50:59.127922 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":110,"threads_started":1}
I20260810 04:50:59.128980 22189 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41637
I20260810 04:50:59.129124 22189 heartbeater.cc:464] Registering TS with master...
I20260810 04:50:59.129348 22189 heartbeater.cc:511] Master 127.15.239.254:41637 requested a full tablet report, sending...
I20260810 04:50:59.129995 21877 ts_manager.cc:194] Registered new tserver with Master: 45247bf218e24ad1863cd3b5f3dc04c9 (127.15.239.193:37733)
I20260810 04:50:59.130723 21877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:57231
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
W20260810 04:51:00.039850 16319 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.15.239.194: real 0.920s user 0.000s sys 0.005s
I20260810 04:51:00.040398 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41637
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:51:00.131888 22189 heartbeater.cc:503] Master 127.15.239.254:41637 was elected leader, sending a full tablet report...
W20260810 04:51:00.139714 22196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:00.139999 22196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:00.140056 22196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:00.141285 22196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:00.141353 22196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:00.141397 22196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:00.142961 22196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:00.143261 22196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:00.143539 22196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:51:00.149456 22196 server_base.cc:1034] running on GCE node
W20260810 04:51:00.149379 22208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:00.149365 22211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:00.149351 22207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:00.149875 22196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:00.150108 22196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:00.151252 22196 hybrid_clock.cc:648] HybridClock initialized: now 1786337460151229 us; error 37 us; skew 500 ppm
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:00.154150 22196 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:51:00.154676 22196 webserver.cc:460] Webserver started at http://127.15.239.194:33865/ using document root <none> and password file <none>
I20260810 04:51:00.154934 22196 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:00.155005 22196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:00.155169 22196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:00.156445 22196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "8434c053f1044f2c9f57169b07034d6c"
format_stamp: "Formatted at 2026-08-10 04:51:00 on dist-test-slave-kvfs"
server_key: "a659d54b14d37847955755c7036f41e3"
server_key_iv: "53d896ea0aef857fbecac40c4201d78f"
server_key_version: "encryptionkey@0"
I20260810 04:51:00.156850 22196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "8434c053f1044f2c9f57169b07034d6c"
format_stamp: "Formatted at 2026-08-10 04:51:00 on dist-test-slave-kvfs"
server_key: "a659d54b14d37847955755c7036f41e3"
server_key_iv: "53d896ea0aef857fbecac40c4201d78f"
server_key_version: "encryptionkey@0"
I20260810 04:51:00.158367 22196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:00.159191 22222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:00.159642 22196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:00.159780 22196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "8434c053f1044f2c9f57169b07034d6c"
format_stamp: "Formatted at 2026-08-10 04:51:00 on dist-test-slave-kvfs"
server_key: "a659d54b14d37847955755c7036f41e3"
server_key_iv: "53d896ea0aef857fbecac40c4201d78f"
server_key_version: "encryptionkey@0"
I20260810 04:51:00.159871 22196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:00.180907 22196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:00.183619 22196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:00.183815 22196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:00.184134 22196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:00.184545 22196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:00.184603 22196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:00.184643 22196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:00.184685 22196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:00.191763 22196 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:33327
I20260810 04:51:00.191819 22410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:33327 every 8 connection(s)
I20260810 04:51:00.192256 22196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:00.198401 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 22196
I20260810 04:51:00.198570 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:00.198815 16319 external_mini_cluster.cc:1428] Setting key 8c73ff613ef9526dbf7d7fed29456bc9
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:00.204092 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:00.193193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:43631 (local address 127.15.239.254:41637)
0810 04:51:00.193403 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:00.193408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:00.193517 (+ 109us) server_negotiation.cc:407] Connection header received
0810 04:51:00.194638 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:00.194640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:00.194656 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:00.194744 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:00.195507 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.196153 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.197245 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.197491 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.197552 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:00.200375 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:00.200377 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:00.200377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:00.200389 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:00.202066 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.202512 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.202514 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.202514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.202600 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.202892 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.202894 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.202894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.203192 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:00.203307 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:00.203671 (+ 364us) server_negotiation.cc:299] Negotiation successful
0810 04:51:00.203843 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":98,"threads_started":1}
I20260810 04:51:00.204239 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:00.193153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41637 (local address 127.15.239.194:43631)
0810 04:51:00.193363 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:00.193409 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:00.194496 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:00.194813 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:00.194817 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:00.195139 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:00.195384 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:00.195388 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.196254 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.196255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:00.197151 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:00.197153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.197569 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.197570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:00.197691 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:00.198342 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:00.198352 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:00.200260 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:00.202172 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:00.202180 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:00.202183 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:00.202428 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:00.202677 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:00.202677 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:00.202678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:00.202828 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:00.203282 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:00.203290 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:00.203507 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 04:51:00.203646 (+ 139us) client_negotiation.cc:240] Negotiation successful
0810 04:51:00.203872 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260810 04:51:00.204804 22411 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41637
I20260810 04:51:00.204941 22411 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:00.205181 22411 heartbeater.cc:511] Master 127.15.239.254:41637 requested a full tablet report, sending...
I20260810 04:51:00.205752 21877 ts_manager.cc:194] Registered new tserver with Master: 8434c053f1044f2c9f57169b07034d6c (127.15.239.194:33327)
I20260810 04:51:00.206338 21877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:43631
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:51:00.231036 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41637
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:00.331924 22426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:00.332252 22426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:00.332283 22426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:00.333557 22426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:00.333596 22426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:00.333623 22426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:00.335206 22426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:00.335448 22426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:00.335671 22426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:00.341900 22438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:00.341904 22436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:00.341902 22433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:00.342526 22426 server_base.cc:1034] running on GCE node
I20260810 04:51:00.342820 22426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:00.343125 22426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:00.344296 22426 hybrid_clock.cc:648] HybridClock initialized: now 1786337460344281 us; error 37 us; skew 500 ppm
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:00.347397 22426 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:51:00.347929 22426 webserver.cc:460] Webserver started at http://127.15.239.195:37067/ using document root <none> and password file <none>
I20260810 04:51:00.348255 22426 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:00.348335 22426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:00.348512 22426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:00.349735 22426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "7ed554ee3e254ffcbe028871bc1148d8"
format_stamp: "Formatted at 2026-08-10 04:51:00 on dist-test-slave-kvfs"
server_key: "6577d6b79002315591843540dc8f7bf1"
server_key_iv: "632a84424adf1a05517b548db8e86545"
server_key_version: "encryptionkey@0"
I20260810 04:51:00.350155 22426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "7ed554ee3e254ffcbe028871bc1148d8"
format_stamp: "Formatted at 2026-08-10 04:51:00 on dist-test-slave-kvfs"
server_key: "6577d6b79002315591843540dc8f7bf1"
server_key_iv: "632a84424adf1a05517b548db8e86545"
server_key_version: "encryptionkey@0"
I20260810 04:51:00.351747 22426 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:00.352759 22452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:00.353013 22426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:00.353142 22426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "7ed554ee3e254ffcbe028871bc1148d8"
format_stamp: "Formatted at 2026-08-10 04:51:00 on dist-test-slave-kvfs"
server_key: "6577d6b79002315591843540dc8f7bf1"
server_key_iv: "632a84424adf1a05517b548db8e86545"
server_key_version: "encryptionkey@0"
I20260810 04:51:00.353228 22426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:00.376350 22426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:00.378875 22426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:00.379086 22426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:00.379413 22426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:00.379833 22426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:00.379894 22426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:00.379935 22426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:00.379966 22426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:00.387310 22426 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:46509
I20260810 04:51:00.387368 22640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:46509 every 8 connection(s)
I20260810 04:51:00.387784 22426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:00.388659 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 22426
I20260810 04:51:00.388787 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:00.389091 16319 external_mini_cluster.cc:1428] Setting key 4f5dfc9dba281b7fbbae1f6af6a551db
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:00.399204 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:00.388765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:46729 (local address 127.15.239.254:41637)
0810 04:51:00.388833 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:00.388835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:00.389151 (+ 316us) server_negotiation.cc:407] Connection header received
0810 04:51:00.390645 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:00.390646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:00.390657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:00.390703 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:00.391447 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.392120 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.393243 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.393478 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.393541 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:00.395920 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:00.395922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:00.395922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:00.395930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:00.397605 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.398096 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.398097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.398098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.398164 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.398509 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.398510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.398510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.398647 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:00.398704 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:00.399023 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 04:51:00.399118 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:51:00.399423 22644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:00.388747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41637 (local address 127.15.239.195:46729)
0810 04:51:00.388962 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:00.389008 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:00.390542 (+ 1534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:00.390776 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:00.390779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:00.391089 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:00.391334 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:00.391338 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.392218 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.392219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:00.393142 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:00.393144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.393561 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.393562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:00.393690 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:00.394258 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:00.394269 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:00.395829 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:00.397680 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:00.397686 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:00.397688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:00.397961 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:00.398260 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:00.398261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:00.398261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:00.398416 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:00.398710 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:00.398716 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:00.398889 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 04:51:00.398992 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 04:51:00.399138 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":106,"threads_started":1}
I20260810 04:51:00.400125 22641 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41637
I20260810 04:51:00.400274 22641 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:00.400550 22641 heartbeater.cc:511] Master 127.15.239.254:41637 requested a full tablet report, sending...
I20260810 04:51:00.401095 21877 ts_manager.cc:194] Registered new tserver with Master: 7ed554ee3e254ffcbe028871bc1148d8 (127.15.239.195:46509)
I20260810 04:51:00.401574 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:51:00.401649 21877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:46729
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:51:00.430698 22661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:00.421998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.15.239.193:37733)
0810 04:51:00.422196 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:00.422206 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:00.422223 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:51:00.422260 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:00.422263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:00.422281 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:00.422380 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:00.423049 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.423875 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.424748 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.425126 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.425189 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:00.427706 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:00.427717 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:00.427717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:00.427724 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:00.429477 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.429861 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.429864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.429865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.429928 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.430182 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.430183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.430183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.430332 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:00.430470 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:00.430536 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 04:51:00.430604 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[21800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:00.440122 22418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:00.432616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48298 (local address 127.15.239.254:41637)
0810 04:51:00.432692 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:00.432696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:00.432709 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:51:00.432737 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:00.432738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:00.432748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:00.432821 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:00.433327 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.433878 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.434577 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:00.434794 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:00.434858 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:00.437419 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:00.437421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:00.437422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:00.437430 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:00.438775 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.439138 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.439140 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.439140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.439207 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:00.439440 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:00.439441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:00.439442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:00.439668 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:00.439773 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:00.439869 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 04:51:00.439952 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 04:51:00.440457 21877 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48298
I20260810 04:51:00.440910 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 21991
I20260810 04:51:00.461558 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 22196
I20260810 04:51:00.480840 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 22426
I20260810 04:51:00.498500 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 21821
2026-08-10T04:51:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4013 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[22671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[22671](info): set up 2 sockets
Aug 10 04:51:00 dist-test-slave-kvfs krb5kdc[22671](info): commencing operation
krb5kdc: starting...
W20260810 04:51:01.793679 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:01 dist-test-slave-kvfs krb5kdc[22671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:51:01.940605 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:34617
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:34617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:02.037753 22692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:02.038017 22692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:02.038043 22692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:02.039278 22692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:02.039323 22692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:02.039338 22692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:02.039351 22692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:02.039364 22692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:02.041115 22692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:34617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:34617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:02.041414 22692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:02.041700 22692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:51:02.047612 22692 server_base.cc:1034] running on GCE node
W20260810 04:51:02.047550 22703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.047600 22706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.047550 22701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:02.048242 22692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:02.048612 22692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:02.049786 22692 hybrid_clock.cc:648] HybridClock initialized: now 1786337462049756 us; error 60 us; skew 500 ppm
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:02.057575 22692 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:51:02.058065 22692 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:02.058146 22692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:02.058318 22692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:02.059659 22692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "40413dcda26446eaba961594e0580e89"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "d83085f414ae489737d99531aa3f863f"
server_key_iv: "32f94625badd602e48c1a04180195bb5"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.060163 22692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "40413dcda26446eaba961594e0580e89"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "d83085f414ae489737d99531aa3f863f"
server_key_iv: "32f94625badd602e48c1a04180195bb5"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.061746 22692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:02.062765 22713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.063025 22692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:02.063166 22692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "40413dcda26446eaba961594e0580e89"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "d83085f414ae489737d99531aa3f863f"
server_key_iv: "32f94625badd602e48c1a04180195bb5"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.063261 22692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:02.071798 22692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:02.074008 22692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:02.074193 22692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:02.079509 22692 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:34617
I20260810 04:51:02.079528 22806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:34617 every 8 connection(s)
I20260810 04:51:02.080011 22692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:02.081386 22808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:02.084259 22808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89: Bootstrap starting.
I20260810 04:51:02.084936 22808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:02.085234 22808 log.cc:824] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:02.086097 22808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89: No bootstrap required, opened a new log
I20260810 04:51:02.087984 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 22692
I20260810 04:51:02.088152 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:02.088045 22808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40413dcda26446eaba961594e0580e89" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34617 } }
I20260810 04:51:02.088286 22808 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:02.088333 22808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40413dcda26446eaba961594e0580e89, State: Initialized, Role: FOLLOWER
I20260810 04:51:02.088392 16319 external_mini_cluster.cc:1428] Setting key f21aafde3e8462bd1df3bf1b8015ac15
I20260810 04:51:02.088531 22808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40413dcda26446eaba961594e0580e89" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34617 } }
I20260810 04:51:02.088629 22808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:02.088692 22808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:02.088747 22808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:02.089875 22808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40413dcda26446eaba961594e0580e89" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34617 } }
I20260810 04:51:02.089980 22808 leader_election.cc:302] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40413dcda26446eaba961594e0580e89; no voters:
I20260810 04:51:02.090181 22808 leader_election.cc:288] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:02.090250 22817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:02.090444 22817 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [term 1 LEADER]: Becoming Leader. State: Replica: 40413dcda26446eaba961594e0580e89, State: Running, Role: LEADER
I20260810 04:51:02.090657 22817 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40413dcda26446eaba961594e0580e89" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34617 } }
I20260810 04:51:02.091164 22822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40413dcda26446eaba961594e0580e89. Latest consensus state: current_term: 1 leader_uuid: "40413dcda26446eaba961594e0580e89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40413dcda26446eaba961594e0580e89" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34617 } } }
I20260810 04:51:02.091205 22820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40413dcda26446eaba961594e0580e89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40413dcda26446eaba961594e0580e89" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34617 } } }
I20260810 04:51:02.091353 22820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:02.090538 22808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:02.091336 22822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:02.091801 22830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:02.092537 22830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:02.094821 22830 catalog_manager.cc:1347] Generated new cluster ID: fb72c5a949414b898e80b498737fea18
I20260810 04:51:02.094889 22830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:02.100575 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.089016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34780 (local address 127.15.239.254:34617)
0810 04:51:02.089231 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.089243 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.089287 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:51:02.089432 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.089439 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.089501 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.089660 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:02.090632 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.092204 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.093339 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.093992 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.094114 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.096838 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:02.096843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:02.096844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:02.096857 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:02.098728 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.099159 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.099162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.099163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.099283 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.099524 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.099525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.099526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.099812 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:02.100077 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.100160 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.100335 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260810 04:51:02.106247 22830 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:02.107021 22830 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:02.116039 22830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89: Generated new TSK 0
I20260810 04:51:02.116271 22830 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:51:02.151933 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:34617
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:02.247870 22864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:02.248206 22864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:02.248240 22864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:02.249478 22864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:02.249526 22864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:02.249555 22864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:02.251207 22864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:02.251533 22864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:02.251832 22864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:02.258013 22877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.258035 22871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.258013 22874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:02.258323 22864 server_base.cc:1034] running on GCE node
I20260810 04:51:02.258603 22864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:02.258889 22864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:02.260080 22864 hybrid_clock.cc:648] HybridClock initialized: now 1786337462260047 us; error 45 us; skew 500 ppm
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:02.263016 22864 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:51:02.263485 22864 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:02.263566 22864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:02.263737 22864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:02.265053 22864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "9d938f4e5d9f49378fb17dca0cf3ac06"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "0ce54e08d320de34cb0b81a85880aa9d"
server_key_iv: "3d0414ae1a9055007425ab524faa26a0"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.265488 22864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "9d938f4e5d9f49378fb17dca0cf3ac06"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "0ce54e08d320de34cb0b81a85880aa9d"
server_key_iv: "3d0414ae1a9055007425ab524faa26a0"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.267119 22864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:02.268124 22887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.268321 22864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:02.268455 22864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "9d938f4e5d9f49378fb17dca0cf3ac06"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "0ce54e08d320de34cb0b81a85880aa9d"
server_key_iv: "3d0414ae1a9055007425ab524faa26a0"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.268539 22864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:02.290555 22864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:02.293550 22864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:02.293738 22864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:02.294051 22864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:02.294453 22864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:02.294510 22864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.294564 22864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:02.294595 22864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.302227 22864 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:35729
I20260810 04:51:02.302260 23098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:35729 every 8 connection(s)
I20260810 04:51:02.302621 22864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:02.309819 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 22864
I20260810 04:51:02.309940 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:02.310199 16319 external_mini_cluster.cc:1428] Setting key 26cf6422f90af41ee121ab8272aa80b7
I20260810 04:51:02.314041 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.303492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:46563 (local address 127.15.239.254:34617)
0810 04:51:02.303592 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.303595 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.303784 (+ 189us) server_negotiation.cc:407] Connection header received
0810 04:51:02.304476 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.304478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.304495 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.304550 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:02.305684 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.306273 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.307390 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.307649 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.307711 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.310536 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:02.310539 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:02.310540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:02.310553 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:02.312297 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.312824 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.312825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.312825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.312884 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.313195 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.313195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.313196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.313380 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:02.313463 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.313795 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.313904 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 04:51:02.314131 23101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.303438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:34617 (local address 127.15.239.193:46563)
0810 04:51:02.303634 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.303682 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.304364 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.304628 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.304632 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.304965 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:02.305597 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.305603 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.306372 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.306373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.307302 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.307305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.307733 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.307734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.307881 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.308519 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:02.308530 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:02.310346 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:02.312382 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:02.312392 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:02.312395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:02.312746 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:02.312947 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:02.312948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:02.312948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:02.313131 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:02.313462 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:02.313471 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:02.313654 (+ 183us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.313749 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.313893 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":117,"threads_started":1}
I20260810 04:51:02.314806 23099 heartbeater.cc:347] Connected to a master server at 127.15.239.254:34617
I20260810 04:51:02.314929 23099 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:02.315102 23099 heartbeater.cc:511] Master 127.15.239.254:34617 requested a full tablet report, sending...
I20260810 04:51:02.315836 22741 ts_manager.cc:194] Registered new tserver with Master: 9d938f4e5d9f49378fb17dca0cf3ac06 (127.15.239.193:35729)
I20260810 04:51:02.316869 22741 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:46563
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:51:02.343415 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:34617
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:02.438493 23106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:02.438738 23106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:02.438763 23106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:02.440107 23106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:02.440153 23106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:02.440181 23106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:02.441746 23106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:02.442030 23106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:02.442296 23106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:02.448079 23113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.448102 23116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:02.448246 23106 server_base.cc:1034] running on GCE node
W20260810 04:51:02.448074 23118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:02.448606 23106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:02.448854 23106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:02.450042 23106 hybrid_clock.cc:648] HybridClock initialized: now 1786337462450024 us; error 39 us; skew 500 ppm
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:02.453011 23106 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:51:02.453461 23106 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:02.453514 23106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:02.453687 23106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:02.454882 23106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "7defad2beae84c5983b5294d32b668c0"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "21741ff557f116bc867be351ea9035d5"
server_key_iv: "29c174cea26caa209852be989983cbe7"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.455296 23106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "7defad2beae84c5983b5294d32b668c0"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "21741ff557f116bc867be351ea9035d5"
server_key_iv: "29c174cea26caa209852be989983cbe7"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.456897 23106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:51:02.457717 23128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.457971 23106 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:02.458094 23106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "7defad2beae84c5983b5294d32b668c0"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "21741ff557f116bc867be351ea9035d5"
server_key_iv: "29c174cea26caa209852be989983cbe7"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.458177 23106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:02.470873 23106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:02.473567 23106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:02.473764 23106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:02.474069 23106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:02.474442 23106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:02.474498 23106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.474536 23106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:02.474584 23106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.481690 23106 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:40141
I20260810 04:51:02.481729 23307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:40141 every 8 connection(s)
I20260810 04:51:02.482090 23106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:02.490734 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 23106
I20260810 04:51:02.490878 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:02.491137 16319 external_mini_cluster.cc:1428] Setting key 0b5e35df7ddb3c96ac51c97bc0ba1fff
I20260810 04:51:02.493192 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.482992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:38391 (local address 127.15.239.254:34617)
0810 04:51:02.483074 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.483077 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.483314 (+ 237us) server_negotiation.cc:407] Connection header received
0810 04:51:02.483874 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.483875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.483888 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.483944 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:02.485021 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.485628 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.486681 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.486909 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.486986 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.489641 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:02.489642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:02.489643 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:02.489659 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:02.491409 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.491957 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.491958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.491959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.492086 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.492358 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.492359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.492360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.492532 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:02.492611 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.492937 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.493045 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:51:02.493376 23310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.482971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:34617 (local address 127.15.239.194:38391)
0810 04:51:02.483174 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.483216 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.483772 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.484006 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.484010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.484315 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:02.484915 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.484920 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.485711 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.485712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.486575 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.486578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.486996 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.486997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.487114 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.487705 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:02.487715 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:02.489528 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:02.491570 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:02.491577 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:02.491579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:02.491874 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:02.492148 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:02.492149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:02.492150 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:02.492283 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:02.492600 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:02.492607 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:02.492767 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.492887 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.493065 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":107,"threads_started":1}
I20260810 04:51:02.493958 23308 heartbeater.cc:347] Connected to a master server at 127.15.239.254:34617
I20260810 04:51:02.494088 23308 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:02.494273 23308 heartbeater.cc:511] Master 127.15.239.254:34617 requested a full tablet report, sending...
I20260810 04:51:02.494767 22741 ts_manager.cc:194] Registered new tserver with Master: 7defad2beae84c5983b5294d32b668c0 (127.15.239.194:40141)
I20260810 04:51:02.495321 22741 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:38391
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:51:02.524861 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:34617
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:02.623323 23316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:02.623621 23316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:02.623662 23316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:02.624989 23316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:02.625062 23316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:02.625108 23316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:02.626755 23316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:34617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:02.627068 23316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:02.627364 23316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:51:02.633551 23316 server_base.cc:1034] running on GCE node
W20260810 04:51:02.633558 23326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.633683 23331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.633569 23322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:02.634037 23316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:02.634275 23316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:02.635430 23316 hybrid_clock.cc:648] HybridClock initialized: now 1786337462635407 us; error 33 us; skew 500 ppm
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:02.638470 23316 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:51:02.638926 23316 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:02.639007 23316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:02.639175 23316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:02.640504 23316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "55f37dc548c84fd8a3789ef6c305c41d"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "e70b60fe932064b0c797978fb4d00048"
server_key_iv: "1328f9bb6e799f5a5faf9bca4211f830"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.640926 23316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "55f37dc548c84fd8a3789ef6c305c41d"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "e70b60fe932064b0c797978fb4d00048"
server_key_iv: "1328f9bb6e799f5a5faf9bca4211f830"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.642397 23316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:02.643234 23344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.643447 23316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:02.643570 23316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "55f37dc548c84fd8a3789ef6c305c41d"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "e70b60fe932064b0c797978fb4d00048"
server_key_iv: "1328f9bb6e799f5a5faf9bca4211f830"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.643654 23316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:02.659886 23316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:02.662580 23316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:02.662760 23316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:02.663045 23316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:02.663451 23316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:02.663522 23316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.663571 23316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:02.663604 23316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.671280 23316 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:44029
I20260810 04:51:02.671312 23533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:44029 every 8 connection(s)
I20260810 04:51:02.671700 23316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:02.672242 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 23316
I20260810 04:51:02.672366 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:02.672626 16319 external_mini_cluster.cc:1428] Setting key cd214ad4b90a4e9aedbdbda59efa2a62
Aug 10 04:51:02 dist-test-slave-kvfs krb5kdc[22671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337462, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:02.681942 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.672732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:43483 (local address 127.15.239.254:34617)
0810 04:51:02.672801 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.672804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.673007 (+ 203us) server_negotiation.cc:407] Connection header received
0810 04:51:02.673704 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.673704 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.673720 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.673785 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:02.674961 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.675513 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.676679 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.676888 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.676955 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.679276 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:02.679277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:02.679278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:02.679286 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:02.680665 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.681056 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.681057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.681058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.681112 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.681341 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.681341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.681342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.681453 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:02.681507 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.681786 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.681854 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:51:02.682153 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.672639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:34617 (local address 127.15.239.195:43483)
0810 04:51:02.672863 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.672913 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.673589 (+ 676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.673877 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.673889 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.674242 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:02.674861 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.674867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.675602 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.675603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.676591 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.676594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.676969 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.676970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.677089 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.677637 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:02.677646 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:02.679184 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:02.680739 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:02.680745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:02.680747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:02.680989 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:02.681172 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:02.681172 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:02.681173 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:02.681279 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:02.681517 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:02.681530 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:02.681665 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.681758 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.681893 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":98,"threads_started":1}
I20260810 04:51:02.682753 23534 heartbeater.cc:347] Connected to a master server at 127.15.239.254:34617
I20260810 04:51:02.682878 23534 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:02.683055 23534 heartbeater.cc:511] Master 127.15.239.254:34617 requested a full tablet report, sending...
I20260810 04:51:02.683516 22741 ts_manager.cc:194] Registered new tserver with Master: 55f37dc548c84fd8a3789ef6c305c41d (127.15.239.195:44029)
I20260810 04:51:02.683928 22741 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:43483
I20260810 04:51:02.684736 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:51:02.693077 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.686250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34786 (local address 127.15.239.254:34617)
0810 04:51:02.686319 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.686321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.686464 (+ 143us) server_negotiation.cc:407] Connection header received
0810 04:51:02.686500 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.686501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.686510 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.686557 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:02.687128 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.687616 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.688457 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.688644 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.688702 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.690117 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:02.690119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:02.690119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:02.690127 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:02.691618 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.691983 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.691984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.691985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.692121 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:02.692351 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:02.692352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:02.692353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:02.692561 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:02.692689 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.692853 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.692951 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:51:02.695188 22741 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:02.697384 22741 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:02.705750 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.701236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41016 (local address 127.15.239.194:40141)
0810 04:51:02.701443 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.701447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.701760 (+ 313us) server_negotiation.cc:407] Connection header received
0810 04:51:02.701815 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.701818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.701834 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.701925 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:02.702041 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.702921 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.704581 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.705192 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.705314 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.705388 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.705571 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.705621 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":115,"threads_started":1}
I20260810 04:51:02.705801 23558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.700703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44029 (local address 127.0.0.1:33436)
0810 04:51:02.701420 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.701431 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.701500 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.701744 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.701748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.701751 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:02.701982 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.701984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.703370 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.703371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.704448 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.704451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.705481 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.705483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.705552 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.705557 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.705605 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.705653 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"mutex_wait_us":36,"spinlock_wait_cycles":768,"thread_start_us":130,"threads_started":1}
I20260810 04:51:02.706030 23565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.700885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49870 (local address 127.15.239.193:35729)
0810 04:51:02.701510 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.701515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.701527 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:02.701580 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.701582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.701603 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.701705 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:02.702336 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.703447 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.704739 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.705480 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.705548 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.705599 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.705870 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.705929 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":118,"threads_started":1}
I20260810 04:51:02.706166 23559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.700699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:35729 (local address 127.0.0.1:49870)
0810 04:51:02.701130 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.701181 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.701288 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.702190 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.702192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.702194 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:02.702244 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.702245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.703569 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.703570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.704647 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.704649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.705633 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.705634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.705688 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.705692 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.705739 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.705777 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":95,"threads_started":1}
I20260810 04:51:02.706305 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.700853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33436 (local address 127.15.239.195:44029)
0810 04:51:02.701092 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.701099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.701499 (+ 400us) server_negotiation.cc:407] Connection header received
0810 04:51:02.701592 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.701593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.701608 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.701712 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:02.702094 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.703236 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.704537 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.705302 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.705381 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.705439 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.706018 (+ 579us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.706094 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":142,"threads_started":1}
I20260810 04:51:02.705801 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.700970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:40141 (local address 127.0.0.1:41016)
0810 04:51:02.701617 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.701629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.701686 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.701935 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.701936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.701939 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:02.701989 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.701990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.703040 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.703041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.704468 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.704471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.705312 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.705314 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.705415 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.705431 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.705550 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.705617 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"mutex_wait_us":1,"thread_start_us":66,"threads_started":1}
I20260810 04:51:02.707161 22981 tablet_service.cc:1467] Processing CreateTablet for tablet cd5ec31eb3124068a9d11a651a88f7cb (DEFAULT_TABLE table=test-table [id=033ef634b6914d25b5e2f0988314d883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:02.707659 22981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ec31eb3124068a9d11a651a88f7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:02.708491 23209 tablet_service.cc:1467] Processing CreateTablet for tablet cd5ec31eb3124068a9d11a651a88f7cb (DEFAULT_TABLE table=test-table [id=033ef634b6914d25b5e2f0988314d883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:02.708859 23209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ec31eb3124068a9d11a651a88f7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:02.711236 23574 tablet_bootstrap.cc:492] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: Bootstrap starting.
I20260810 04:51:02.712060 23576 tablet_bootstrap.cc:492] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Bootstrap starting.
I20260810 04:51:02.712095 23574 tablet_bootstrap.cc:654] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:02.712455 23417 tablet_service.cc:1467] Processing CreateTablet for tablet cd5ec31eb3124068a9d11a651a88f7cb (DEFAULT_TABLE table=test-table [id=033ef634b6914d25b5e2f0988314d883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:02.712798 23417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ec31eb3124068a9d11a651a88f7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:02.712854 23574 log.cc:824] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:02.712913 23576 tablet_bootstrap.cc:654] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:02.713598 23576 log.cc:824] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:02.713963 23574 tablet_bootstrap.cc:492] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: No bootstrap required, opened a new log
I20260810 04:51:02.714043 23574 ts_tablet_manager.cc:1397] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:51:02.714427 23576 tablet_bootstrap.cc:492] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: No bootstrap required, opened a new log
I20260810 04:51:02.714521 23576 ts_tablet_manager.cc:1397] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:51:02.716094 23576 raft_consensus.cc:348] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.716316 23576 raft_consensus.cc:374] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:02.716389 23576 raft_consensus.cc:729] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7defad2beae84c5983b5294d32b668c0, State: Initialized, Role: FOLLOWER
I20260810 04:51:02.716372 23574 raft_consensus.cc:348] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.716563 23574 raft_consensus.cc:374] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:02.716609 23574 raft_consensus.cc:729] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d938f4e5d9f49378fb17dca0cf3ac06, State: Initialized, Role: FOLLOWER
I20260810 04:51:02.716583 23576 consensus_queue.cc:260] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.716670 23584 tablet_bootstrap.cc:492] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Bootstrap starting.
I20260810 04:51:02.716813 23574 consensus_queue.cc:260] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.716933 23576 ts_tablet_manager.cc:1428] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:51:02.717031 23308 heartbeater.cc:503] Master 127.15.239.254:34617 was elected leader, sending a full tablet report...
I20260810 04:51:02.717206 23574 ts_tablet_manager.cc:1428] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:51:02.717348 23099 heartbeater.cc:503] Master 127.15.239.254:34617 was elected leader, sending a full tablet report...
I20260810 04:51:02.717499 23584 tablet_bootstrap.cc:654] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:02.718709 23584 log.cc:824] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:02.719533 23584 tablet_bootstrap.cc:492] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: No bootstrap required, opened a new log
I20260810 04:51:02.719614 23584 ts_tablet_manager.cc:1397] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:51:02.721350 23584 raft_consensus.cc:348] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.721505 23584 raft_consensus.cc:374] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:02.721532 23584 raft_consensus.cc:729] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f37dc548c84fd8a3789ef6c305c41d, State: Initialized, Role: FOLLOWER
I20260810 04:51:02.721679 23584 consensus_queue.cc:260] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.721997 23584 ts_tablet_manager.cc:1428] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:51:02.722061 23534 heartbeater.cc:503] Master 127.15.239.254:34617 was elected leader, sending a full tablet report...
I20260810 04:51:02.726151 23588 raft_consensus.cc:482] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:02.726275 23588 raft_consensus.cc:504] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.726689 23588 leader_election.cc:288] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55f37dc548c84fd8a3789ef6c305c41d (127.15.239.195:44029), 7defad2beae84c5983b5294d32b668c0 (127.15.239.194:40141)
I20260810 04:51:02.730178 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.727155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:58785 (local address 127.15.239.194:40141)
0810 04:51:02.727229 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.727231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.727371 (+ 140us) server_negotiation.cc:407] Connection header received
0810 04:51:02.727402 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.727403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.727415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.727478 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:02.727650 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.728291 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.729317 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.729776 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.729877 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.729889 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.730058 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.730099 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 04:51:02.730193 23591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.727055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:40141 (local address 127.15.239.193:58785)
0810 04:51:02.727291 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.727299 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.727350 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.727501 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.727502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.727504 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:02.727580 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.727581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.728370 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.728371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.729232 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.729236 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.729878 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.729879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.729969 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.729973 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.730050 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.730095 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":143,"threads_started":1}
I20260810 04:51:02.730268 23561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.726985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:45173 (local address 127.15.239.195:44029)
0810 04:51:02.727056 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.727059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.727072 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:51:02.727134 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.727135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.727148 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.727209 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:02.727502 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.728148 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.729354 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.729829 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.729924 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.729936 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.730135 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.730180 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:51:02.730281 23101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.726927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44029 (local address 127.15.239.193:45173)
0810 04:51:02.727000 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.727016 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:02.727072 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:02.727290 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:02.727291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:02.727293 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:02.727397 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.727399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.728222 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.728223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.729237 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:02.729240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.729923 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.729924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:02.730036 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.730040 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:02.730124 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 04:51:02.730169 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":5}
I20260810 04:51:02.730629 23450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ec31eb3124068a9d11a651a88f7cb" candidate_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f37dc548c84fd8a3789ef6c305c41d" is_pre_election: true
I20260810 04:51:02.730815 23450 raft_consensus.cc:2454] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d938f4e5d9f49378fb17dca0cf3ac06 in term 0.
I20260810 04:51:02.731053 23238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ec31eb3124068a9d11a651a88f7cb" candidate_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7defad2beae84c5983b5294d32b668c0" is_pre_election: true
I20260810 04:51:02.731106 22893 leader_election.cc:302] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55f37dc548c84fd8a3789ef6c305c41d, 9d938f4e5d9f49378fb17dca0cf3ac06; no voters:
I20260810 04:51:02.731204 23238 raft_consensus.cc:2454] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d938f4e5d9f49378fb17dca0cf3ac06 in term 0.
I20260810 04:51:02.731261 23588 raft_consensus.cc:2781] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:02.731317 23588 raft_consensus.cc:482] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:02.731379 23588 raft_consensus.cc:3037] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:02.732350 23588 raft_consensus.cc:504] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.732477 23588 leader_election.cc:288] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [CANDIDATE]: Term 1 election: Requested vote from peers 55f37dc548c84fd8a3789ef6c305c41d (127.15.239.195:44029), 7defad2beae84c5983b5294d32b668c0 (127.15.239.194:40141)
W20260810 04:51:02.732695 23309 tablet.cc:2369] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:51:02.732755 23238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ec31eb3124068a9d11a651a88f7cb" candidate_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7defad2beae84c5983b5294d32b668c0"
I20260810 04:51:02.732885 23238 raft_consensus.cc:3037] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:02.733104 23450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ec31eb3124068a9d11a651a88f7cb" candidate_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f37dc548c84fd8a3789ef6c305c41d"
I20260810 04:51:02.733193 23450 raft_consensus.cc:3037] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:02.733798 23238 raft_consensus.cc:2454] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d938f4e5d9f49378fb17dca0cf3ac06 in term 1.
I20260810 04:51:02.734027 22893 leader_election.cc:302] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7defad2beae84c5983b5294d32b668c0, 9d938f4e5d9f49378fb17dca0cf3ac06; no voters:
I20260810 04:51:02.734088 23450 raft_consensus.cc:2454] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d938f4e5d9f49378fb17dca0cf3ac06 in term 1.
I20260810 04:51:02.734169 23588 raft_consensus.cc:2781] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:02.734381 23588 raft_consensus.cc:686] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [term 1 LEADER]: Becoming Leader. State: Replica: 9d938f4e5d9f49378fb17dca0cf3ac06, State: Running, Role: LEADER
I20260810 04:51:02.734527 23588 consensus_queue.cc:237] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } }
I20260810 04:51:02.735589 22740 catalog_manager.cc:5495] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d938f4e5d9f49378fb17dca0cf3ac06 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d938f4e5d9f49378fb17dca0cf3ac06" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 35729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260810 04:51:02.741479 23565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.739151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.15.239.193:35729)
0810 04:51:02.739194 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.739196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.739211 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:51:02.739263 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.739264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.739282 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.739342 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:02.739465 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.739934 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.740765 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:02.740951 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:02.741005 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:02.741173 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:02.741281 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:02.741345 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.741376 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.741395 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:51:02.743573 23238 raft_consensus.cc:1261] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 1 FOLLOWER]: Refusing update from remote peer 9d938f4e5d9f49378fb17dca0cf3ac06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:02.743573 23450 raft_consensus.cc:1261] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 1 FOLLOWER]: Refusing update from remote peer 9d938f4e5d9f49378fb17dca0cf3ac06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:02.743989 23588 consensus_queue.cc:1035] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55f37dc548c84fd8a3789ef6c305c41d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:02.744174 23595 consensus_queue.cc:1035] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7defad2beae84c5983b5294d32b668c0" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:02.746901 23604 mvcc.cc:205] Tried to move back new op lower bound from 7316838247394525184 to 7316838247361269760. Current Snapshot: MvccSnapshot[applied={T|T < 7316838247394525184}]
I20260810 04:51:02.747462 23605 mvcc.cc:205] Tried to move back new op lower bound from 7316838247394525184 to 7316838247361269760. Current Snapshot: MvccSnapshot[applied={T|T < 7316838247394525184}]
I20260810 04:51:02.749755 22741 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:02.749863 22741 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:02.750860 22741 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40413dcda26446eaba961594e0580e89: Sending DeleteTablet for 3 replicas of tablet cd5ec31eb3124068a9d11a651a88f7cb
I20260810 04:51:02.751235 22981 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5ec31eb3124068a9d11a651a88f7cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:02 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:49870
I20260810 04:51:02.751286 23417 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5ec31eb3124068a9d11a651a88f7cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:02 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:33436
I20260810 04:51:02.751358 23209 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5ec31eb3124068a9d11a651a88f7cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:02 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:41016
I20260810 04:51:02.751724 23619 tablet_replica.cc:330] T cd5ec31eb3124068a9d11a651a88f7cb P 9d938f4e5d9f49378fb17dca0cf3ac06: stopping tablet replica
I20260810 04:51:02.751874 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 22864
I20260810 04:51:02.760216 23620 tablet_replica.cc:330] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: stopping tablet replica
I20260810 04:51:02.760394 23620 raft_consensus.cc:2229] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:02.760558 23620 raft_consensus.cc:2258] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:02.760557 23621 tablet_replica.cc:330] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: stopping tablet replica
I20260810 04:51:02.760842 23621 raft_consensus.cc:2229] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:02.761000 23621 raft_consensus.cc:2258] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:02.761161 23620 ts_tablet_manager.cc:1905] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:02.761541 23621 ts_tablet_manager.cc:1905] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:02.763154 23620 ts_tablet_manager.cc:1918] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:02.763239 23620 log.cc:1196] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/cd5ec31eb3124068a9d11a651a88f7cb
I20260810 04:51:02.763497 23621 ts_tablet_manager.cc:1918] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:02.763594 23621 log.cc:1196] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/cd5ec31eb3124068a9d11a651a88f7cb
I20260810 04:51:02.763597 23620 ts_tablet_manager.cc:1939] T cd5ec31eb3124068a9d11a651a88f7cb P 55f37dc548c84fd8a3789ef6c305c41d: Deleting consensus metadata
I20260810 04:51:02.763945 23621 ts_tablet_manager.cc:1939] T cd5ec31eb3124068a9d11a651a88f7cb P 7defad2beae84c5983b5294d32b668c0: Deleting consensus metadata
I20260810 04:51:02.764206 22720 catalog_manager.cc:4841] TS 55f37dc548c84fd8a3789ef6c305c41d (127.15.239.195:44029): tablet cd5ec31eb3124068a9d11a651a88f7cb (table test-table [id=033ef634b6914d25b5e2f0988314d883]) successfully deleted
I20260810 04:51:02.764423 22720 catalog_manager.cc:4841] TS 7defad2beae84c5983b5294d32b668c0 (127.15.239.194:40141): tablet cd5ec31eb3124068a9d11a651a88f7cb (table test-table [id=033ef634b6914d25b5e2f0988314d883]) successfully deleted
W20260810 04:51:02.766106 22719 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:35729 (error 108)
I20260810 04:51:02.766470 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 23106
I20260810 04:51:02.773168 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.766689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:35729 (local address 127.0.0.1:49886)
0810 04:51:02.773028 (+ 6339us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:02.773107 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:35729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6298}
W20260810 04:51:02.777208 22719 catalog_manager.cc:4584] TS 9d938f4e5d9f49378fb17dca0cf3ac06 (127.15.239.193:35729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cd5ec31eb3124068a9d11a651a88f7cb: Network error: Client connection negotiation failed: client connection to 127.15.239.193:35729: connect: Connection refused (error 111)
I20260810 04:51:02.783905 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 23316
I20260810 04:51:02.800822 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 22692
2026-08-10T04:51:02Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2303 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T04:51:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:02Z Disabled control of system clock
I20260810 04:51:02.846339 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:45011
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:45057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:45011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:51:02.945389 23630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:02.945664 23630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:02.945688 23630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:02.946849 23630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:02.946884 23630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:02.946897 23630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:02.946910 23630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:02.946923 23630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:02.948323 23630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:45011
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:45011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:02.948578 23630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:02.948905 23630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:02.954568 23646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.954581 23639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:02.954632 23643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:02.954879 23630 server_base.cc:1034] running on GCE node
I20260810 04:51:02.955292 23630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:02.955631 23630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:02.956835 23630 hybrid_clock.cc:648] HybridClock initialized: now 1786337462956787 us; error 40 us; skew 500 ppm
I20260810 04:51:02.958541 23630 webserver.cc:460] Webserver started at http://127.15.239.254:35107/ using document root <none> and password file <none>
I20260810 04:51:02.958858 23630 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:02.958940 23630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:02.959115 23630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:02.960501 23630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "982917d2e5594c71905f6a0064888890"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "44f7dea236395416c23f3eefe4cdf8d7"
server_key_iv: "764c6e0908b65020e062463af5c0fa30"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.960930 23630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "982917d2e5594c71905f6a0064888890"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "44f7dea236395416c23f3eefe4cdf8d7"
server_key_iv: "764c6e0908b65020e062463af5c0fa30"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.962477 23630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:02.963377 23653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:02.963656 23630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:02.963802 23630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "982917d2e5594c71905f6a0064888890"
format_stamp: "Formatted at 2026-08-10 04:51:02 on dist-test-slave-kvfs"
server_key: "44f7dea236395416c23f3eefe4cdf8d7"
server_key_iv: "764c6e0908b65020e062463af5c0fa30"
server_key_version: "encryptionkey@0"
I20260810 04:51:02.963898 23630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:02.968384 23630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:02.968756 23630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:02.968935 23630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:02.974754 23630 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:45011
I20260810 04:51:02.974789 23746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:45011 every 8 connection(s)
I20260810 04:51:02.975265 23630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:02.976630 23748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:02.979513 23748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890: Bootstrap starting.
I20260810 04:51:02.980324 23748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:02.980703 23748 log.cc:824] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:02.981586 23748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890: No bootstrap required, opened a new log
I20260810 04:51:02.982559 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 23630
I20260810 04:51:02.982686 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:02.982908 16319 external_mini_cluster.cc:1428] Setting key 6eddf4881c137e3ce81514c5cee7d2fd
I20260810 04:51:02.984088 23748 raft_consensus.cc:348] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "982917d2e5594c71905f6a0064888890" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45011 } }
I20260810 04:51:02.984302 23748 raft_consensus.cc:374] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:02.984345 23748 raft_consensus.cc:729] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 982917d2e5594c71905f6a0064888890, State: Initialized, Role: FOLLOWER
I20260810 04:51:02.984570 23748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "982917d2e5594c71905f6a0064888890" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45011 } }
I20260810 04:51:02.984695 23748 raft_consensus.cc:388] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:02.984745 23748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:02.984802 23748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:02.985620 23748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "982917d2e5594c71905f6a0064888890" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45011 } }
I20260810 04:51:02.985718 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:02.983613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33314 (local address 127.15.239.254:45011)
0810 04:51:02.983873 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:02.983882 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:02.983913 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:51:02.984093 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:02.984100 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:02.984141 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:02.984280 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:02.985187 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:02.985190 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:02.985191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:02.985194 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:02.985226 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:02.985237 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:02.985296 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:02.985403 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 04:51:02.985493 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":119,"threads_started":1}
I20260810 04:51:02.985754 23748 leader_election.cc:302] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 982917d2e5594c71905f6a0064888890; no voters:
I20260810 04:51:02.985963 23748 leader_election.cc:288] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:02.986173 23755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:02.986316 23748 sys_catalog.cc:564] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:02.986364 23755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [term 1 LEADER]: Becoming Leader. State: Replica: 982917d2e5594c71905f6a0064888890, State: Running, Role: LEADER
I20260810 04:51:02.986567 23755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "982917d2e5594c71905f6a0064888890" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45011 } }
I20260810 04:51:02.987025 23759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 982917d2e5594c71905f6a0064888890. Latest consensus state: current_term: 1 leader_uuid: "982917d2e5594c71905f6a0064888890" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "982917d2e5594c71905f6a0064888890" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45011 } } }
I20260810 04:51:02.987018 23757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "982917d2e5594c71905f6a0064888890" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "982917d2e5594c71905f6a0064888890" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45011 } } }
I20260810 04:51:02.987160 23757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:02.987370 23768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:02.987370 23759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:02.988142 23768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:02.989940 23768 catalog_manager.cc:1347] Generated new cluster ID: cb7224818bb24e59acb83688f51f10ce
I20260810 04:51:02.989988 23768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:03.004789 23768 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:03.005039 23768 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:03.012620 23768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890: Generated new TSK 0
I20260810 04:51:03.012899 23768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:51:03.023317 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:45011
--builtin_ntp_servers=127.15.239.212:45057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:51:03.121618 23789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:03.121950 23789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:03.121997 23789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:03.123404 23789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:03.123451 23789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:03.123481 23789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:03.124950 23789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:45011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:03.125183 23789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:03.125486 23789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:03.131199 23800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.131217 23798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.131219 23797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.131717 23789 server_base.cc:1034] running on GCE node
I20260810 04:51:03.131982 23789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:03.132315 23789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:03.133479 23789 hybrid_clock.cc:648] HybridClock initialized: now 1786337463133467 us; error 32 us; skew 500 ppm
I20260810 04:51:03.135099 23789 webserver.cc:460] Webserver started at http://127.15.239.193:42981/ using document root <none> and password file <none>
I20260810 04:51:03.135390 23789 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:03.135442 23789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:03.135609 23789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:03.136931 23789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "349987928ad7495d9dabedf1e297cecd"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "21de0d359c925dc43f21adef264b42a4"
server_key_iv: "89d6aaf1b0130deb1a8e1771e70800cd"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.137348 23789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "349987928ad7495d9dabedf1e297cecd"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "21de0d359c925dc43f21adef264b42a4"
server_key_iv: "89d6aaf1b0130deb1a8e1771e70800cd"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.138885 23789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:51:03.139878 23808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.140120 23789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:03.140247 23789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "349987928ad7495d9dabedf1e297cecd"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "21de0d359c925dc43f21adef264b42a4"
server_key_iv: "89d6aaf1b0130deb1a8e1771e70800cd"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.140332 23789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:03.144008 23789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:03.144340 23789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:03.144497 23789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:03.144742 23789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:03.145113 23789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:03.145174 23789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.145215 23789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:03.145241 23789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.152272 23789 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:46219
I20260810 04:51:03.152320 24005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:46219 every 8 connection(s)
I20260810 04:51:03.152716 23789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:03.156947 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.153718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:59869 (local address 127.15.239.254:45011)
0810 04:51:03.153881 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.153885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.154140 (+ 255us) server_negotiation.cc:407] Connection header received
0810 04:51:03.154910 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.154912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.154926 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.155003 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.156571 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.156573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.156573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.156578 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.156608 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.156614 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.156696 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.156830 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.156853 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260810 04:51:03.157191 24010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.153670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:45011 (local address 127.15.239.193:59869)
0810 04:51:03.153979 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.154025 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.154742 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.155111 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.155115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.155126 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.156385 (+ 1259us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.156386 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.156426 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.156462 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.156691 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.156698 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.156703 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.156841 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.156918 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":113,"threads_started":1}
I20260810 04:51:03.157946 24007 heartbeater.cc:347] Connected to a master server at 127.15.239.254:45011
I20260810 04:51:03.158053 24007 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:03.158198 24007 heartbeater.cc:511] Master 127.15.239.254:45011 requested a full tablet report, sending...
I20260810 04:51:03.158963 23678 ts_manager.cc:194] Registered new tserver with Master: 349987928ad7495d9dabedf1e297cecd (127.15.239.193:46219)
I20260810 04:51:03.160939 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 23789
I20260810 04:51:03.161037 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:03.161268 16319 external_mini_cluster.cc:1428] Setting key 0bf4271fb6b877ee150b87c50c61688e
I20260810 04:51:03.162406 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:45011
--builtin_ntp_servers=127.15.239.212:45057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:51:03.261204 24011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:03.261459 24011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:03.261484 24011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:03.262744 24011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:03.262790 24011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:03.262825 24011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:03.264366 24011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:45011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:03.264668 24011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:03.265029 24011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:03.270915 24022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.271028 24011 server_base.cc:1034] running on GCE node
W20260810 04:51:03.270974 24021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.270937 24025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.271409 24011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:03.271689 24011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:03.272897 24011 hybrid_clock.cc:648] HybridClock initialized: now 1786337463272884 us; error 48 us; skew 500 ppm
I20260810 04:51:03.274585 24011 webserver.cc:460] Webserver started at http://127.15.239.194:40343/ using document root <none> and password file <none>
I20260810 04:51:03.274955 24011 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:03.275046 24011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:03.275239 24011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:03.276702 24011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "408ab74b86f240478af7968f9ef4c082"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "ef685fa5d92230eaeb2b12eab53633f6"
server_key_iv: "851d84f1f5c16cd81cff857f7fbeb2ba"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.277168 24011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "408ab74b86f240478af7968f9ef4c082"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "ef685fa5d92230eaeb2b12eab53633f6"
server_key_iv: "851d84f1f5c16cd81cff857f7fbeb2ba"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.278785 24011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:03.279742 24035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.280066 24011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:03.280185 24011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "408ab74b86f240478af7968f9ef4c082"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "ef685fa5d92230eaeb2b12eab53633f6"
server_key_iv: "851d84f1f5c16cd81cff857f7fbeb2ba"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.280282 24011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:03.283993 24011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:03.284317 24011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:03.284479 24011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:03.284729 24011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:03.285084 24011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:03.285141 24011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.285182 24011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:03.285211 24011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.292400 24011 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:37307
I20260810 04:51:03.292448 24211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:37307 every 8 connection(s)
I20260810 04:51:03.292826 24011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:03.296347 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.293703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:53835 (local address 127.15.239.254:45011)
0810 04:51:03.293775 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.293777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.294060 (+ 283us) server_negotiation.cc:407] Connection header received
0810 04:51:03.294628 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.294629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.294638 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.294701 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.296068 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.296070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.296071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.296089 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.296120 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.296126 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.296182 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.296258 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.296274 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:51:03.296581 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.293684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:45011 (local address 127.15.239.194:53835)
0810 04:51:03.293915 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.293953 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.294500 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.294788 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.294792 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.294802 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.295862 (+ 1060us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.295862 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.295894 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.295926 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.296191 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.296196 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.296199 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.296263 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.296322 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":116,"threads_started":1}
I20260810 04:51:03.297086 24212 heartbeater.cc:347] Connected to a master server at 127.15.239.254:45011
I20260810 04:51:03.297183 24212 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:03.297389 24212 heartbeater.cc:511] Master 127.15.239.254:45011 requested a full tablet report, sending...
I20260810 04:51:03.297842 23678 ts_manager.cc:194] Registered new tserver with Master: 408ab74b86f240478af7968f9ef4c082 (127.15.239.194:37307)
I20260810 04:51:03.299804 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 24011
I20260810 04:51:03.299896 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:03.300104 16319 external_mini_cluster.cc:1428] Setting key c542758ff3081ac0c10138c09f1c19dc
I20260810 04:51:03.301057 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:45011
--builtin_ntp_servers=127.15.239.212:45057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 04:51:03.398319 24217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:03.398591 24217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:03.398614 24217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:03.399843 24217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:03.399884 24217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:03.399910 24217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:03.401391 24217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:45011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:03.401696 24217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:03.402051 24217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:03.407760 24228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.407781 24226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.407773 24217 server_base.cc:1034] running on GCE node
W20260810 04:51:03.407912 24225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.408378 24217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:03.408671 24217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:03.409848 24217 hybrid_clock.cc:648] HybridClock initialized: now 1786337463409834 us; error 30 us; skew 500 ppm
I20260810 04:51:03.411369 24217 webserver.cc:460] Webserver started at http://127.15.239.195:36893/ using document root <none> and password file <none>
I20260810 04:51:03.411667 24217 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:03.411721 24217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:03.411908 24217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:03.413203 24217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "8df9511b93994b5d8cb0641efb57bf0c"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "389125c90e2620b86c72be6878d49648"
server_key_iv: "3f0acd1b6d4d1d1165f5b8426fc11807"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.413611 24217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "8df9511b93994b5d8cb0641efb57bf0c"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "389125c90e2620b86c72be6878d49648"
server_key_iv: "3f0acd1b6d4d1d1165f5b8426fc11807"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.415082 24217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:51:03.415875 24234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.416105 24217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:03.416229 24217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "8df9511b93994b5d8cb0641efb57bf0c"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "389125c90e2620b86c72be6878d49648"
server_key_iv: "3f0acd1b6d4d1d1165f5b8426fc11807"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.416316 24217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:03.419991 24217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:03.420334 24217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:03.420493 24217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:03.420733 24217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:03.421099 24217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:03.421168 24217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.421209 24217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:03.421236 24217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.428009 24217 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:35465
I20260810 04:51:03.428092 24425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:35465 every 8 connection(s)
I20260810 04:51:03.428494 24217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:03.431887 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.429409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:36265 (local address 127.15.239.254:45011)
0810 04:51:03.429509 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.429511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.429709 (+ 198us) server_negotiation.cc:407] Connection header received
0810 04:51:03.430277 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.430278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.430286 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.430349 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.431695 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.431696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.431696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.431699 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.431712 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.431716 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.431760 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.431809 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.431822 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 04:51:03.432125 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.429350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:45011 (local address 127.15.239.195:36265)
0810 04:51:03.429572 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.429613 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.430173 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.430422 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.430425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.430435 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.431550 (+ 1115us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.431551 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.431585 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.431617 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.431758 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.431760 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.431763 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.431816 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.431871 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":111,"threads_started":1}
I20260810 04:51:03.432742 24426 heartbeater.cc:347] Connected to a master server at 127.15.239.254:45011
I20260810 04:51:03.432855 24426 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:03.433028 24426 heartbeater.cc:511] Master 127.15.239.254:45011 requested a full tablet report, sending...
I20260810 04:51:03.433456 23678 ts_manager.cc:194] Registered new tserver with Master: 8df9511b93994b5d8cb0641efb57bf0c (127.15.239.195:35465)
I20260810 04:51:03.438278 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 24217
I20260810 04:51:03.438408 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:03.438637 16319 external_mini_cluster.cc:1428] Setting key 12bb0fe3240c0a924658944252febc62
I20260810 04:51:03.439630 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:51:03.442708 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.441344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.15.239.254:45011)
0810 04:51:03.441444 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.441446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.441540 (+ 94us) server_negotiation.cc:407] Connection header received
0810 04:51:03.441639 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.441640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.441648 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.441711 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.442451 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.442453 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.442453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.442458 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.442478 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.442483 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.442541 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.442604 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.442621 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 04:51:03.444854 23678 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:03.446961 23678 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:03.452044 24447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.450159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39996 (local address 127.15.239.194:37307)
0810 04:51:03.450546 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.450551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.450562 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:03.450595 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.450597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.450612 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.450729 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.451671 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.451680 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.451680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.451687 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.451728 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.451749 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.451825 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.451907 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.451924 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":102,"threads_started":1}
I20260810 04:51:03.452014 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.449907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:37307 (local address 127.0.0.1:39996)
0810 04:51:03.450237 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.450288 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.450358 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.451172 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.451173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.451176 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.451567 (+ 391us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.451567 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.451572 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.451583 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.451817 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.451824 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.451828 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.451899 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.451924 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":248,"threads_started":1}
I20260810 04:51:03.452046 24442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.449909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:46219 (local address 127.0.0.1:48474)
0810 04:51:03.450260 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.450288 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.450358 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.450795 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.450804 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.450813 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.451476 (+ 663us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.451476 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.451515 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.451544 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.451833 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.451834 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.451835 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.451903 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.451917 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":155,"threads_started":1}
I20260810 04:51:03.452390 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.450043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48474 (local address 127.15.239.193:46219)
0810 04:51:03.450593 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.450597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.450608 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:03.450639 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.450641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.450651 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.450769 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.451649 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.451662 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.451662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.451667 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.451714 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.451752 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.451842 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.452276 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.452298 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":113,"threads_started":1}
I20260810 04:51:03.452878 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.449907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35465 (local address 127.0.0.1:38144)
0810 04:51:03.450380 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.450391 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.450447 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.451158 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.451159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.451161 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.451901 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.451902 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.451909 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.451922 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.452725 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.452726 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.452727 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.452802 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.452815 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"mutex_wait_us":5,"thread_start_us":61,"threads_started":1}
I20260810 04:51:03.452919 24451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.450176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38144 (local address 127.15.239.195:35465)
0810 04:51:03.450569 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.450574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.450584 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:03.450617 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.450620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.450630 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.450725 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.452007 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.452015 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.452016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.452021 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.452610 (+ 589us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.452638 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.452700 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.452813 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.452829 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":124,"threads_started":1}
I20260810 04:51:03.453182 24113 tablet_service.cc:1467] Processing CreateTablet for tablet 295cf102947d41deb74a0bb95ac5f968 (DEFAULT_TABLE table=test-table [id=4dd65ee54c6c4c22adee7fe6a1f68b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:03.453184 23892 tablet_service.cc:1467] Processing CreateTablet for tablet 295cf102947d41deb74a0bb95ac5f968 (DEFAULT_TABLE table=test-table [id=4dd65ee54c6c4c22adee7fe6a1f68b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:03.453648 23892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 295cf102947d41deb74a0bb95ac5f968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:03.453647 24113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 295cf102947d41deb74a0bb95ac5f968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:03.453665 24317 tablet_service.cc:1467] Processing CreateTablet for tablet 295cf102947d41deb74a0bb95ac5f968 (DEFAULT_TABLE table=test-table [id=4dd65ee54c6c4c22adee7fe6a1f68b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:03.454056 24317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 295cf102947d41deb74a0bb95ac5f968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:03.457163 24452 tablet_bootstrap.cc:492] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Bootstrap starting.
I20260810 04:51:03.457695 24454 tablet_bootstrap.cc:492] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Bootstrap starting.
I20260810 04:51:03.458051 24452 tablet_bootstrap.cc:654] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:03.458353 24454 tablet_bootstrap.cc:654] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:03.458562 24452 log.cc:824] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:03.458721 24454 log.cc:824] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:03.459117 24453 tablet_bootstrap.cc:492] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: Bootstrap starting.
I20260810 04:51:03.459424 24452 tablet_bootstrap.cc:492] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: No bootstrap required, opened a new log
I20260810 04:51:03.459519 24452 ts_tablet_manager.cc:1397] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:51:03.459785 24453 tablet_bootstrap.cc:654] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:03.460199 24453 log.cc:824] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:03.460450 24454 tablet_bootstrap.cc:492] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: No bootstrap required, opened a new log
I20260810 04:51:03.460525 24454 ts_tablet_manager.cc:1397] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:51:03.461066 24453 tablet_bootstrap.cc:492] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: No bootstrap required, opened a new log
I20260810 04:51:03.461187 24453 ts_tablet_manager.cc:1397] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:51:03.461966 24452 raft_consensus.cc:348] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.462148 24452 raft_consensus.cc:374] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:03.462195 24452 raft_consensus.cc:729] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8df9511b93994b5d8cb0641efb57bf0c, State: Initialized, Role: FOLLOWER
I20260810 04:51:03.462340 24452 consensus_queue.cc:260] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.462667 24452 ts_tablet_manager.cc:1428] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:51:03.462808 24426 heartbeater.cc:503] Master 127.15.239.254:45011 was elected leader, sending a full tablet report...
I20260810 04:51:03.463599 24454 raft_consensus.cc:348] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.463802 24454 raft_consensus.cc:374] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:03.463840 24454 raft_consensus.cc:729] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 408ab74b86f240478af7968f9ef4c082, State: Initialized, Role: FOLLOWER
I20260810 04:51:03.464000 24454 consensus_queue.cc:260] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.464130 24453 raft_consensus.cc:348] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.464287 24454 ts_tablet_manager.cc:1428] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 04:51:03.464299 24453 raft_consensus.cc:374] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:03.464411 24212 heartbeater.cc:503] Master 127.15.239.254:45011 was elected leader, sending a full tablet report...
I20260810 04:51:03.464349 24453 raft_consensus.cc:729] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 349987928ad7495d9dabedf1e297cecd, State: Initialized, Role: FOLLOWER
I20260810 04:51:03.464759 24453 consensus_queue.cc:260] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.465072 24453 ts_tablet_manager.cc:1428] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 04:51:03.465131 24007 heartbeater.cc:503] Master 127.15.239.254:45011 was elected leader, sending a full tablet report...
I20260810 04:51:03.468225 24462 raft_consensus.cc:482] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:03.468324 24462 raft_consensus.cc:504] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.468633 24462 leader_election.cc:288] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8df9511b93994b5d8cb0641efb57bf0c (127.15.239.195:35465), 349987928ad7495d9dabedf1e297cecd (127.15.239.193:46219)
I20260810 04:51:03.470081 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.468839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:35465 (local address 127.15.239.194:46013)
0810 04:51:03.468993 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.469005 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.469069 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.469228 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.469229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.469232 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.469714 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.469714 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.469722 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.469735 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.469941 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.469942 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.469942 (+ 0us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.469995 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.470011 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260810 04:51:03.470243 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.468892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:46321 (local address 127.15.239.193:46219)
0810 04:51:03.469176 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.469179 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.469187 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:03.469211 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.469212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.469216 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.469265 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.470025 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.470026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.470027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.470032 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.470049 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.470053 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.470106 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.470157 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.470174 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259}
I20260810 04:51:03.470270 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.468840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:46219 (local address 127.15.239.194:46321)
0810 04:51:03.469096 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.469106 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.469150 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.469268 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.469268 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.469270 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:03.469888 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:03.469889 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:03.469897 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:03.469911 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:03.470108 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:03.470109 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:03.470110 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 04:51:03.470158 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:51:03.470172 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":59,"thread_start_us":128,"threads_started":1}
I20260810 04:51:03.470357 24451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.468939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:46013 (local address 127.15.239.195:35465)
0810 04:51:03.468997 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.469001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.469055 (+ 54us) server_negotiation.cc:407] Connection header received
0810 04:51:03.469137 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.469138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.469143 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.469220 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.469822 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.469824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.469824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.469829 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.469845 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.469849 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.469922 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.470261 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.470277 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:51:03.470592 23927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295cf102947d41deb74a0bb95ac5f968" candidate_uuid: "408ab74b86f240478af7968f9ef4c082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "349987928ad7495d9dabedf1e297cecd" is_pre_election: true
I20260810 04:51:03.470664 24353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295cf102947d41deb74a0bb95ac5f968" candidate_uuid: "408ab74b86f240478af7968f9ef4c082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8df9511b93994b5d8cb0641efb57bf0c" is_pre_election: true
I20260810 04:51:03.470757 23927 raft_consensus.cc:2454] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 408ab74b86f240478af7968f9ef4c082 in term 0.
I20260810 04:51:03.470785 24353 raft_consensus.cc:2454] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 408ab74b86f240478af7968f9ef4c082 in term 0.
I20260810 04:51:03.470999 24042 leader_election.cc:302] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 349987928ad7495d9dabedf1e297cecd, 408ab74b86f240478af7968f9ef4c082; no voters:
I20260810 04:51:03.471176 24462 raft_consensus.cc:2781] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:03.471247 24462 raft_consensus.cc:482] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:03.471283 24462 raft_consensus.cc:3037] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:03.472127 24462 raft_consensus.cc:504] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.472280 24462 leader_election.cc:288] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [CANDIDATE]: Term 1 election: Requested vote from peers 8df9511b93994b5d8cb0641efb57bf0c (127.15.239.195:35465), 349987928ad7495d9dabedf1e297cecd (127.15.239.193:46219)
I20260810 04:51:03.472499 24353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295cf102947d41deb74a0bb95ac5f968" candidate_uuid: "408ab74b86f240478af7968f9ef4c082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8df9511b93994b5d8cb0641efb57bf0c"
I20260810 04:51:03.472585 24353 raft_consensus.cc:3037] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:03.472569 23927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295cf102947d41deb74a0bb95ac5f968" candidate_uuid: "408ab74b86f240478af7968f9ef4c082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "349987928ad7495d9dabedf1e297cecd"
I20260810 04:51:03.472669 23927 raft_consensus.cc:3037] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:03.473446 24353 raft_consensus.cc:2454] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 408ab74b86f240478af7968f9ef4c082 in term 1.
I20260810 04:51:03.473451 23927 raft_consensus.cc:2454] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 408ab74b86f240478af7968f9ef4c082 in term 1.
I20260810 04:51:03.473651 24042 leader_election.cc:302] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 349987928ad7495d9dabedf1e297cecd, 408ab74b86f240478af7968f9ef4c082; no voters:
I20260810 04:51:03.473747 24462 raft_consensus.cc:2781] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:03.473905 24462 raft_consensus.cc:686] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 1 LEADER]: Becoming Leader. State: Replica: 408ab74b86f240478af7968f9ef4c082, State: Running, Role: LEADER
I20260810 04:51:03.474022 24462 consensus_queue.cc:237] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } }
I20260810 04:51:03.475064 23678 catalog_manager.cc:5495] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 408ab74b86f240478af7968f9ef4c082 (127.15.239.194). New cstate: current_term: 1 leader_uuid: "408ab74b86f240478af7968f9ef4c082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "408ab74b86f240478af7968f9ef4c082" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37307 } health_report { overall_health: HEALTHY } } }
I20260810 04:51:03.485901 24447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.484658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40008 (local address 127.15.239.194:37307)
0810 04:51:03.484725 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.484727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.484753 (+ 26us) server_negotiation.cc:407] Connection header received
0810 04:51:03.484862 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.484863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.484878 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.484948 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.485630 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.485633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.485633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.485639 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.485659 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.485664 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.485725 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.485787 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.485804 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:51:03.488468 23927 raft_consensus.cc:1261] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 1 FOLLOWER]: Refusing update from remote peer 408ab74b86f240478af7968f9ef4c082: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:03.488468 24353 raft_consensus.cc:1261] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 1 FOLLOWER]: Refusing update from remote peer 408ab74b86f240478af7968f9ef4c082: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:03.488849 24462 consensus_queue.cc:1035] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8df9511b93994b5d8cb0641efb57bf0c" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:03.489064 24467 consensus_queue.cc:1035] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "349987928ad7495d9dabedf1e297cecd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:03.492182 24473 mvcc.cc:205] Tried to move back new op lower bound from 7316838250445238272 to 7316838250390515712. Current Snapshot: MvccSnapshot[applied={T|T < 7316838250445238272}]
I20260810 04:51:03.494941 23676 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:03.495060 23676 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:03.496006 23676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 982917d2e5594c71905f6a0064888890: Sending DeleteTablet for 3 replicas of tablet 295cf102947d41deb74a0bb95ac5f968
I20260810 04:51:03.496415 24317 tablet_service.cc:1514] Processing DeleteTablet for tablet 295cf102947d41deb74a0bb95ac5f968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:03 UTC) from {username='slave'} at 127.0.0.1:38144
I20260810 04:51:03.496480 23892 tablet_service.cc:1514] Processing DeleteTablet for tablet 295cf102947d41deb74a0bb95ac5f968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:03 UTC) from {username='slave'} at 127.0.0.1:48474
I20260810 04:51:03.496737 24488 tablet_replica.cc:330] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd: stopping tablet replica
I20260810 04:51:03.496855 24488 raft_consensus.cc:2229] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:03.496991 24488 raft_consensus.cc:2258] T 295cf102947d41deb74a0bb95ac5f968 P 349987928ad7495d9dabedf1e297cecd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:03.497002 24113 tablet_service.cc:1514] Processing DeleteTablet for tablet 295cf102947d41deb74a0bb95ac5f968 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:03 UTC) from {username='slave'} at 127.0.0.1:39996
I20260810 04:51:03.497238 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 23789
I20260810 04:51:03.506510 24489 tablet_replica.cc:330] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: stopping tablet replica
I20260810 04:51:03.506745 24489 raft_consensus.cc:2229] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:03.506942 24489 raft_consensus.cc:2258] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:03.507864 24489 ts_tablet_manager.cc:1905] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:03.510759 24489 ts_tablet_manager.cc:1918] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:03.510890 24489 log.cc:1196] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/295cf102947d41deb74a0bb95ac5f968
I20260810 04:51:03.511300 24489 ts_tablet_manager.cc:1939] T 295cf102947d41deb74a0bb95ac5f968 P 408ab74b86f240478af7968f9ef4c082: Deleting consensus metadata
I20260810 04:51:03.512063 23654 catalog_manager.cc:4841] TS 408ab74b86f240478af7968f9ef4c082 (127.15.239.194:37307): tablet 295cf102947d41deb74a0bb95ac5f968 (table test-table [id=4dd65ee54c6c4c22adee7fe6a1f68b24]) successfully deleted
I20260810 04:51:03.514709 24487 tablet_replica.cc:330] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: stopping tablet replica
I20260810 04:51:03.514892 24487 raft_consensus.cc:2229] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:03.515050 24487 raft_consensus.cc:2258] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:03.515679 24487 ts_tablet_manager.cc:1905] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:03.517692 24487 ts_tablet_manager.cc:1918] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:03.517793 24487 log.cc:1196] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/295cf102947d41deb74a0bb95ac5f968
I20260810 04:51:03.518095 24487 ts_tablet_manager.cc:1939] T 295cf102947d41deb74a0bb95ac5f968 P 8df9511b93994b5d8cb0641efb57bf0c: Deleting consensus metadata
I20260810 04:51:03.518718 23656 catalog_manager.cc:4841] TS 8df9511b93994b5d8cb0641efb57bf0c (127.15.239.195:35465): tablet 295cf102947d41deb74a0bb95ac5f968 (table test-table [id=4dd65ee54c6c4c22adee7fe6a1f68b24]) successfully deleted
W20260810 04:51:03.522918 23658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:46219 (error 108)
I20260810 04:51:03.523367 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 24011
I20260810 04:51:03.532174 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.531851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:46219 (local address 127.0.0.1:48480)
0810 04:51:03.531947 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.532108 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:46219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 04:51:03.532357 23658 catalog_manager.cc:4584] TS 349987928ad7495d9dabedf1e297cecd (127.15.239.193:46219): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 295cf102947d41deb74a0bb95ac5f968: Network error: Client connection negotiation failed: client connection to 127.15.239.193:46219: connect: Connection refused (error 111)
I20260810 04:51:03.538710 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 24217
I20260810 04:51:03.559175 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 23630
2026-08-10T04:51:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (753 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 04:51:03.589071 16319 mini_oidc.cc:152] Starting JWKS server
I20260810 04:51:03.590508 16319 webserver.cc:460] Webserver started at https://127.0.0.1:45615/ using document root <none> and password file <none>
I20260810 04:51:03.590601 16319 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 04:51:03.590749 16319 webserver.cc:460] Webserver started at http://127.0.0.1:44179/ using document root <none> and password file <none>
2026-08-10T04:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:03Z Disabled control of system clock
I20260810 04:51:03.601543 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36617
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36617
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45615/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/testchainca.cert with env {}
W20260810 04:51:03.695199 24498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:03.695461 24498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:03.695484 24498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:03.696769 24498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:03.696815 24498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:03.696828 24498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:03.696841 24498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:03.696853 24498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:51:03.696866 24498 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:51:03.696877 24498 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45615/jwks.json
I20260810 04:51:03.698459 24498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36617
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45615/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:03.698683 24498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:03.698863 24498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:03.704389 24518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.704524 24498 server_base.cc:1034] running on GCE node
W20260810 04:51:03.704476 24514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.704389 24516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.705068 24498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:03.705363 24498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:03.706517 24498 hybrid_clock.cc:648] HybridClock initialized: now 1786337463706498 us; error 42 us; skew 500 ppm
I20260810 04:51:03.708012 24498 webserver.cc:460] Webserver started at http://127.15.239.254:46331/ using document root <none> and password file <none>
I20260810 04:51:03.708333 24498 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:03.708385 24498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:03.708530 24498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:03.709695 24498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "7852b915069d49008fb0ffce4cf3bf96"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "f3c0e98ece71a724418103e7243e44a2"
server_key_iv: "07727576b68c713074d318125aff34fb"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.710104 24498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "7852b915069d49008fb0ffce4cf3bf96"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "f3c0e98ece71a724418103e7243e44a2"
server_key_iv: "07727576b68c713074d318125aff34fb"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.711899 24498 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:51:03.712971 24527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.713260 24498 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:03.713374 24498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "7852b915069d49008fb0ffce4cf3bf96"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "f3c0e98ece71a724418103e7243e44a2"
server_key_iv: "07727576b68c713074d318125aff34fb"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.713469 24498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:03.724314 24498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:03.724656 24498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:03.724817 24498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:03.729683 24498 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:36617
I20260810 04:51:03.729805 24617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:36617 every 8 connection(s)
I20260810 04:51:03.730136 24498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:03.731349 24618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:03.734316 24618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96: Bootstrap starting.
I20260810 04:51:03.735044 24618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:03.735430 24618 log.cc:824] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:03.736290 24618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96: No bootstrap required, opened a new log
I20260810 04:51:03.736847 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 24498
I20260810 04:51:03.736970 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:03.737221 16319 external_mini_cluster.cc:1428] Setting key d9eac3a4e45b8d0e6bab29cd0e146e88
I20260810 04:51:03.738758 24618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7852b915069d49008fb0ffce4cf3bf96" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36617 } }
I20260810 04:51:03.738981 24618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:03.739044 24618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7852b915069d49008fb0ffce4cf3bf96, State: Initialized, Role: FOLLOWER
I20260810 04:51:03.739200 24618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7852b915069d49008fb0ffce4cf3bf96" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36617 } }
I20260810 04:51:03.739308 24618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:03.739336 24618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:03.739419 24618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:03.740139 24618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7852b915069d49008fb0ffce4cf3bf96" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36617 } }
I20260810 04:51:03.740278 24618 leader_election.cc:302] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7852b915069d49008fb0ffce4cf3bf96; no voters:
I20260810 04:51:03.740469 24618 leader_election.cc:288] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:03.740511 24623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:03.740671 24623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [term 1 LEADER]: Becoming Leader. State: Replica: 7852b915069d49008fb0ffce4cf3bf96, State: Running, Role: LEADER
I20260810 04:51:03.740785 24618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:03.740829 24623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7852b915069d49008fb0ffce4cf3bf96" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36617 } }
I20260810 04:51:03.741230 24623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7852b915069d49008fb0ffce4cf3bf96. Latest consensus state: current_term: 1 leader_uuid: "7852b915069d49008fb0ffce4cf3bf96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7852b915069d49008fb0ffce4cf3bf96" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36617 } } }
I20260810 04:51:03.741353 24623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:03.741242 24625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7852b915069d49008fb0ffce4cf3bf96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7852b915069d49008fb0ffce4cf3bf96" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36617 } } }
I20260810 04:51:03.741492 24625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96 [sys.catalog]: This master's current role is: LEADER
W20260810 04:51:03.743175 24644 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:51:03.743233 24644 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:51:03.743301 24631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:03.743470 24631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:03.744380 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.737794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33226 (local address 127.15.239.254:36617)
0810 04:51:03.738030 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.738039 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.738067 (+ 28us) server_negotiation.cc:407] Connection header received
0810 04:51:03.738665 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.738673 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.738737 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.738865 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:03.739184 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:03.740742 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:03.741852 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:03.742280 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:03.742530 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:03.743429 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:03.743436 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:03.743437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:03.743754 (+ 317us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:03.743795 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:03.743808 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:03.743897 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:03.744001 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 04:51:03.744114 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
I20260810 04:51:03.745442 24631 catalog_manager.cc:1347] Generated new cluster ID: dd06d0a0a0d843a49fdfb955f4c482c7
I20260810 04:51:03.745515 24631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:03.748510 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:51:03.761539 24631 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:03.762195 24631 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:03.765470 24631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7852b915069d49008fb0ffce4cf3bf96: Generated new TSK 0
I20260810 04:51:03.765709 24631 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 04:51:03.797292 24662 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 04:51:03.797598 24662 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 04:51:03.797590 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:03.773903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33238 (local address 127.15.239.254:36617)
0810 04:51:03.773987 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:03.773990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:03.774206 (+ 216us) server_negotiation.cc:407] Connection header received
0810 04:51:03.774315 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:03.774317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:03.774330 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:03.774411 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:51:03.774631 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:03.775212 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:03.776407 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:03.776605 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:03.776663 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:03.776910 (+ 247us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:51:03.797245 (+ 20335us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45615/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 04:51:03.797481 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33238: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45615/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":48}
W20260810 04:51:03.797679 24622 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33238: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45615/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 04:51:03.798113 24661 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:03.773848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36617 (local address 127.0.0.1:33238)
0810 04:51:03.774095 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:03.774109 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:03.774202 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:03.774438 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:03.774440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:03.774442 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:51:03.774531 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:03.774535 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:03.775298 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:03.775299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:03.776320 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:03.776324 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:03.776696 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:03.776697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:03.776766 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:03.776790 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:51:03.797420 (+ 20630us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45615/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 04:51:03.797576 (+ 156us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.239.254:36617: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45615/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":137,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.239.254:36617: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45615/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 04:51:03.798611 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 24498
2026-08-10T04:51:03Z chronyd exiting
I20260810 04:51:03.856858 16319 test_util.cc:175] -----------------------------------------------
I20260810 04:51:03.857007 16319 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786337435403234-16319-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (269 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 04:51:03.858064 16319 mini_oidc.cc:152] Starting JWKS server
I20260810 04:51:03.858970 16319 webserver.cc:460] Webserver started at https://127.0.0.1:41961/ using document root <none> and password file <none>
I20260810 04:51:03.859045 16319 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 04:51:03.859247 16319 webserver.cc:460] Webserver started at http://127.0.0.1:36185/ using document root <none> and password file <none>
2026-08-10T04:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:03Z Disabled control of system clock
I20260810 04:51:03.870481 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:34921
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:33857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:34921
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41961/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/testchainca.cert with env {}
W20260810 04:51:03.962951 24671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:03.963213 24671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:03.963238 24671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:03.964542 24671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:03.964591 24671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:03.964603 24671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:03.964615 24671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:03.964627 24671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:51:03.964680 24671 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:51:03.964700 24671 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41961/jwks.json
I20260810 04:51:03.966325 24671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:34921
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:34921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41961/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:03.966650 24671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:03.966908 24671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:03.972556 24678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.972556 24680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:03.972580 24676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:03.972973 24671 server_base.cc:1034] running on GCE node
I20260810 04:51:03.973266 24671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:03.973591 24671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:03.974746 24671 hybrid_clock.cc:648] HybridClock initialized: now 1786337463974720 us; error 42 us; skew 500 ppm
I20260810 04:51:03.976394 24671 webserver.cc:460] Webserver started at http://127.15.239.254:39659/ using document root <none> and password file <none>
I20260810 04:51:03.976677 24671 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:03.976754 24671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:03.976924 24671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:03.978168 24671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "8ba000941f834404842d8dc9203fe7e0"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "e612eff0f176e9eaca31396410e1b8c8"
server_key_iv: "a2981e062e0c5a333607871f75b6c8cf"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.978581 24671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "8ba000941f834404842d8dc9203fe7e0"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "e612eff0f176e9eaca31396410e1b8c8"
server_key_iv: "a2981e062e0c5a333607871f75b6c8cf"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.980131 24671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:51:03.980995 24698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:03.981189 24671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:03.981309 24671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "8ba000941f834404842d8dc9203fe7e0"
format_stamp: "Formatted at 2026-08-10 04:51:03 on dist-test-slave-kvfs"
server_key: "e612eff0f176e9eaca31396410e1b8c8"
server_key_iv: "a2981e062e0c5a333607871f75b6c8cf"
server_key_version: "encryptionkey@0"
I20260810 04:51:03.981390 24671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:03.997217 24671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:03.997629 24671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:03.997803 24671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:04.002774 24671 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:34921
I20260810 04:51:04.002811 24782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:34921 every 8 connection(s)
I20260810 04:51:04.003223 24671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:04.004132 24783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:04.005750 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 24671
I20260810 04:51:04.005877 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:04.006115 16319 external_mini_cluster.cc:1428] Setting key cc38c5dadb5cc3c0e01b134e3acb92e2
I20260810 04:51:04.008004 24783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0: Bootstrap starting.
I20260810 04:51:04.008816 24783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:04.009186 24783 log.cc:824] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:04.009979 24783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0: No bootstrap required, opened a new log
I20260810 04:51:04.012395 24783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba000941f834404842d8dc9203fe7e0" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34921 } }
I20260810 04:51:04.012635 24783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:04.012727 24783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba000941f834404842d8dc9203fe7e0, State: Initialized, Role: FOLLOWER
I20260810 04:51:04.012851 24787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:04.006786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.15.239.254:34921)
0810 04:51:04.007010 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:04.007020 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:04.007049 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:51:04.007710 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:04.007720 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:04.007809 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:04.007951 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:04.008267 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.009373 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.010310 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.010760 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.010900 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.011856 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:04.011862 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:04.011862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:04.012168 (+ 306us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:04.012221 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:04.012252 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:04.012309 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:04.012438 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 04:51:04.012559 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260810 04:51:04.012876 24783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba000941f834404842d8dc9203fe7e0" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34921 } }
I20260810 04:51:04.012984 24783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:04.013032 24783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:04.013074 24783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:04.013847 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:51:04.013880 24783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba000941f834404842d8dc9203fe7e0" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34921 } }
I20260810 04:51:04.014026 24783 leader_election.cc:302] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ba000941f834404842d8dc9203fe7e0; no voters:
I20260810 04:51:04.014214 24783 leader_election.cc:288] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:04.014235 24790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:04.014366 24790 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [term 1 LEADER]: Becoming Leader. State: Replica: 8ba000941f834404842d8dc9203fe7e0, State: Running, Role: LEADER
I20260810 04:51:04.014467 24790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba000941f834404842d8dc9203fe7e0" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34921 } }
I20260810 04:51:04.014515 24783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:04.014909 24791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ba000941f834404842d8dc9203fe7e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba000941f834404842d8dc9203fe7e0" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34921 } } }
I20260810 04:51:04.015019 24791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:04.015301 24797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:04.015269 24792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ba000941f834404842d8dc9203fe7e0. Latest consensus state: current_term: 1 leader_uuid: "8ba000941f834404842d8dc9203fe7e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba000941f834404842d8dc9203fe7e0" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 34921 } } }
I20260810 04:51:04.015384 24792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:04.016268 24797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:04.018067 24797 catalog_manager.cc:1347] Generated new cluster ID: 082e7a0237e3489da80319bb03b8f3cb
I20260810 04:51:04.018132 24797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:04.043074 24797 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:04.043686 24797 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:04.053316 24797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ba000941f834404842d8dc9203fe7e0: Generated new TSK 0
I20260810 04:51:04.053553 24797 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 04:51:04.083011 24834 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 04:51:04.083137 24834 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 04:51:04.083482 24787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:04.061790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.15.239.254:34921)
0810 04:51:04.061851 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:04.061869 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:04.062432 (+ 563us) server_negotiation.cc:407] Connection header received
0810 04:51:04.062528 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:04.062529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:04.062549 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:04.062648 (+ 99us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:51:04.062809 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.063327 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.064273 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.064490 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.064574 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.064784 (+ 210us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:51:04.083211 (+ 18427us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 04:51:04.083411 (+ 200us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58112: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":26}
W20260810 04:51:04.083561 24787 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58112: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 04:51:04.083666 24833 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:04.061728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:34921 (local address 127.0.0.1:58112)
0810 04:51:04.062336 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:04.062347 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:04.062456 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:04.062649 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:04.062650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:04.062652 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:51:04.062724 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:04.062727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.063450 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.063451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:04.064186 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:04.064189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.064578 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.064579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:04.064646 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.064652 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:51:04.083370 (+ 18718us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 04:51:04.083547 (+ 177us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.239.254:34921: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41961/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":98,"threads_started":1}
I20260810 04:51:04.084045 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 24671
2026-08-10T04:51:04Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (280 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 04:51:04.138064 16319 mini_oidc.cc:152] Starting JWKS server
I20260810 04:51:04.138900 16319 webserver.cc:460] Webserver started at https://127.0.0.1:46749/ using document root <none> and password file <none>
I20260810 04:51:04.138974 16319 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 04:51:04.139178 16319 webserver.cc:460] Webserver started at http://127.0.0.1:37355/ using document root <none> and password file <none>
2026-08-10T04:51:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:04Z Disabled control of system clock
I20260810 04:51:04.150094 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41543
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:38149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:41543
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46749/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 04:51:04.244055 24845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:04.244314 24845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:04.244338 24845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:04.245573 24845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:04.245612 24845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:04.245625 24845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:04.245637 24845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:04.245651 24845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:51:04.245662 24845 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:51:04.245673 24845 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46749/jwks.json
I20260810 04:51:04.247076 24845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:41543
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46749/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:04.247318 24845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:04.247680 24845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:04.253400 24855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:04.253403 24851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:04.253436 24850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:04.253732 24845 server_base.cc:1034] running on GCE node
I20260810 04:51:04.254092 24845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:04.254434 24845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:04.255576 24845 hybrid_clock.cc:648] HybridClock initialized: now 1786337464255549 us; error 51 us; skew 500 ppm
I20260810 04:51:04.257225 24845 webserver.cc:460] Webserver started at http://127.15.239.254:46119/ using document root <none> and password file <none>
I20260810 04:51:04.257508 24845 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:04.257562 24845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:04.257709 24845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:04.258972 24845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "a0847397fe71456fab8a94b8f8e16319"
format_stamp: "Formatted at 2026-08-10 04:51:04 on dist-test-slave-kvfs"
server_key: "e80c538326e3e750628d2e4777ba7692"
server_key_iv: "d42789321317a420b232c6f120d180b3"
server_key_version: "encryptionkey@0"
I20260810 04:51:04.259377 24845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "a0847397fe71456fab8a94b8f8e16319"
format_stamp: "Formatted at 2026-08-10 04:51:04 on dist-test-slave-kvfs"
server_key: "e80c538326e3e750628d2e4777ba7692"
server_key_iv: "d42789321317a420b232c6f120d180b3"
server_key_version: "encryptionkey@0"
I20260810 04:51:04.261049 24845 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:51:04.261902 24864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:04.262141 24845 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:04.262279 24845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "a0847397fe71456fab8a94b8f8e16319"
format_stamp: "Formatted at 2026-08-10 04:51:04 on dist-test-slave-kvfs"
server_key: "e80c538326e3e750628d2e4777ba7692"
server_key_iv: "d42789321317a420b232c6f120d180b3"
server_key_version: "encryptionkey@0"
I20260810 04:51:04.262367 24845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:04.273495 24845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:04.273890 24845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:04.274085 24845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:04.279466 24845 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:41543
I20260810 04:51:04.279515 24949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:41543 every 8 connection(s)
I20260810 04:51:04.279950 24845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:04.280844 24950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:04.284307 24950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319: Bootstrap starting.
I20260810 04:51:04.285033 24950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:04.285336 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 24845
I20260810 04:51:04.285461 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:04.285421 24950 log.cc:824] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:04.285693 16319 external_mini_cluster.cc:1428] Setting key c22679a90cc9cd7a48a7046d5d905cb8
I20260810 04:51:04.286442 24950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319: No bootstrap required, opened a new log
I20260810 04:51:04.289337 24950 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0847397fe71456fab8a94b8f8e16319" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41543 } }
I20260810 04:51:04.289520 24950 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:04.289573 24950 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0847397fe71456fab8a94b8f8e16319, State: Initialized, Role: FOLLOWER
I20260810 04:51:04.289748 24950 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0847397fe71456fab8a94b8f8e16319" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41543 } }
I20260810 04:51:04.289851 24950 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:04.289886 24950 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:04.289952 24950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:04.290850 24950 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0847397fe71456fab8a94b8f8e16319" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41543 } }
I20260810 04:51:04.291006 24950 leader_election.cc:302] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0847397fe71456fab8a94b8f8e16319; no voters:
I20260810 04:51:04.291249 24950 leader_election.cc:288] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:04.291275 24956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:04.291410 24956 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [term 1 LEADER]: Becoming Leader. State: Replica: a0847397fe71456fab8a94b8f8e16319, State: Running, Role: LEADER
I20260810 04:51:04.291515 24956 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0847397fe71456fab8a94b8f8e16319" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41543 } }
I20260810 04:51:04.291628 24950 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:04.291886 24956 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0847397fe71456fab8a94b8f8e16319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0847397fe71456fab8a94b8f8e16319" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41543 } } }
I20260810 04:51:04.291966 24956 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:04.292164 24956 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0847397fe71456fab8a94b8f8e16319. Latest consensus state: current_term: 1 leader_uuid: "a0847397fe71456fab8a94b8f8e16319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0847397fe71456fab8a94b8f8e16319" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41543 } } }
I20260810 04:51:04.292243 24956 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:04.292272 24961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:04.292963 24961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:04.293393 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:04.286353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58230 (local address 127.15.239.254:41543)
0810 04:51:04.286650 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:04.286659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:04.286688 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:51:04.287867 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:04.287879 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:04.287955 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:04.288168 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:04.288464 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.289470 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.290650 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.291236 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.291382 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.292294 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:04.292298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:04.292299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:04.292567 (+ 268us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:04.292623 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:04.292644 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:04.292709 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:04.293052 (+ 343us) server_negotiation.cc:299] Negotiation successful
0810 04:51:04.293154 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":120,"threads_started":1}
I20260810 04:51:04.294644 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:51:04.295300 24961 catalog_manager.cc:1347] Generated new cluster ID: e599040873dc489ab0d865632800ddbb
I20260810 04:51:04.295360 24961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:04.318954 24961 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:04.319903 24961 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:04.326094 24961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0847397fe71456fab8a94b8f8e16319: Generated new TSK 0
I20260810 04:51:04.326364 24961 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:51:04.337414 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:04.333255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58238 (local address 127.15.239.254:41543)
0810 04:51:04.333310 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:04.333313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:04.333396 (+ 83us) server_negotiation.cc:407] Connection header received
0810 04:51:04.333474 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:04.333475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:04.333493 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:04.333571 (+ 78us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:51:04.333729 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.334549 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.335404 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.335735 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.335826 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.336001 (+ 175us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:51:04.337157 (+ 1156us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46749/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 04:51:04.337328 (+ 171us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58238: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46749/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":30}
W20260810 04:51:04.337487 24955 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58238: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46749/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 04:51:04.339339 24995 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:04.333138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41543 (local address 127.0.0.1:58238)
0810 04:51:04.333306 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:04.333318 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:04.333390 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:04.333584 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:04.333585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:04.333587 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:51:04.333658 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:04.333661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.334658 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.334659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:04.335312 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:04.335314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.335835 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.335836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:04.335887 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.335893 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:51:04.337275 (+ 1382us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46749/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 04:51:04.339225 (+ 1950us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.239.254:41543: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46749/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":1700,"thread_start_us":110,"threads_started":1}
I20260810 04:51:04.339771 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 24845
E20260810 04:51:04.365494 24996 webserver.cc:533] Webserver: sslize failed:
E20260810 04:51:04.365633 24996 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T04:51:04Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (258 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T04:51:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:04Z Disabled control of system clock
I20260810 04:51:04.407140 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39787
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:44945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:39787
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/testchainca.cert with env {}
W20260810 04:51:04.501958 25003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:04.502197 25003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:04.502221 25003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:04.503381 25003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:04.503417 25003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:04.503429 25003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:04.503441 25003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:04.503454 25003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 04:51:04.503466 25003 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 04:51:04.503477 25003 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 04:51:04.505069 25003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:39787
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:04.505312 25003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:04.505503 25003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:04.511103 25020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:04.511103 25017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:04.511133 25003 server_base.cc:1034] running on GCE node
W20260810 04:51:04.511132 25016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:04.511646 25003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:04.511991 25003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:04.513195 25003 hybrid_clock.cc:648] HybridClock initialized: now 1786337464513174 us; error 43 us; skew 500 ppm
I20260810 04:51:04.514698 25003 webserver.cc:460] Webserver started at http://127.15.239.254:37743/ using document root <none> and password file <none>
I20260810 04:51:04.514976 25003 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:04.515051 25003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:04.515215 25003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:04.516530 25003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "f9b7bb0f576241d0a9bce6196fab3a78"
format_stamp: "Formatted at 2026-08-10 04:51:04 on dist-test-slave-kvfs"
server_key: "a9575a3cc1b3bf7358ab6f84a495e4ce"
server_key_iv: "e673e51fe10ab88606093f01087b714d"
server_key_version: "encryptionkey@0"
I20260810 04:51:04.516933 25003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "f9b7bb0f576241d0a9bce6196fab3a78"
format_stamp: "Formatted at 2026-08-10 04:51:04 on dist-test-slave-kvfs"
server_key: "a9575a3cc1b3bf7358ab6f84a495e4ce"
server_key_iv: "e673e51fe10ab88606093f01087b714d"
server_key_version: "encryptionkey@0"
I20260810 04:51:04.518359 25003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 04:51:04.519121 25030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:04.519297 25003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:51:04.519424 25003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "f9b7bb0f576241d0a9bce6196fab3a78"
format_stamp: "Formatted at 2026-08-10 04:51:04 on dist-test-slave-kvfs"
server_key: "a9575a3cc1b3bf7358ab6f84a495e4ce"
server_key_iv: "e673e51fe10ab88606093f01087b714d"
server_key_version: "encryptionkey@0"
I20260810 04:51:04.519505 25003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:04.527545 25003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:04.527894 25003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:04.528131 25003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:04.532759 25003 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:39787
I20260810 04:51:04.532801 25120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:39787 every 8 connection(s)
I20260810 04:51:04.533185 25003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:04.534430 25121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:04.537348 25121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78: Bootstrap starting.
I20260810 04:51:04.538089 25121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:04.538446 25121 log.cc:824] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:04.539254 25121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78: No bootstrap required, opened a new log
I20260810 04:51:04.541231 25121 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39787 } }
I20260810 04:51:04.541390 25121 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:04.541416 25121 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9b7bb0f576241d0a9bce6196fab3a78, State: Initialized, Role: FOLLOWER
I20260810 04:51:04.541599 25121 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39787 } }
I20260810 04:51:04.541667 25121 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:04.541692 25121 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:04.541761 25121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:04.542469 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 25003
I20260810 04:51:04.542476 25121 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39787 } }
I20260810 04:51:04.542598 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:04.542596 25121 leader_election.cc:302] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9b7bb0f576241d0a9bce6196fab3a78; no voters:
I20260810 04:51:04.542790 25121 leader_election.cc:288] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:04.542840 16319 external_mini_cluster.cc:1428] Setting key 837d7016eb999559728145ae8ebfcee4
I20260810 04:51:04.542872 25125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:04.543052 25125 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [term 1 LEADER]: Becoming Leader. State: Replica: f9b7bb0f576241d0a9bce6196fab3a78, State: Running, Role: LEADER
I20260810 04:51:04.543102 25121 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:04.543162 25125 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39787 } }
I20260810 04:51:04.543541 25125 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9b7bb0f576241d0a9bce6196fab3a78. Latest consensus state: current_term: 1 leader_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39787 } } }
I20260810 04:51:04.543625 25125 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:04.543953 25126 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9b7bb0f576241d0a9bce6196fab3a78" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39787 } } }
I20260810 04:51:04.544063 25126 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:04.544430 25134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:04.545260 25134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:04.547055 25134 catalog_manager.cc:1347] Generated new cluster ID: 8efb80b1e98741d28ff0e8a80a0042f6
I20260810 04:51:04.547111 25134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:04.549784 25131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:04.543394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47002 (local address 127.15.239.254:39787)
0810 04:51:04.543814 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:04.543828 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:04.543879 (+ 51us) server_negotiation.cc:407] Connection header received
0810 04:51:04.544041 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:04.544051 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:04.544160 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:04.544332 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:04.544682 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.546162 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.547323 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.547959 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.548112 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.548958 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:04.548962 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:04.548963 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:04.549224 (+ 261us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:04.549270 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:04.549285 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:04.549359 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:04.549478 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 04:51:04.549561 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":92,"threads_started":1}
I20260810 04:51:04.550845 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:51:04.557662 25134 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:04.558220 25134 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:04.566411 25134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9b7bb0f576241d0a9bce6196fab3a78: Generated new TSK 0
I20260810 04:51:04.566627 25134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:51:04.613006 25131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:04.576994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47018 (local address 127.15.239.254:39787)
0810 04:51:04.577047 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:04.577050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:04.577176 (+ 126us) server_negotiation.cc:407] Connection header received
0810 04:51:04.577278 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:04.577279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:04.577292 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:04.577360 (+ 68us) server_negotiation.cc:226] Negotiated authn=JWT
0810 04:51:04.577552 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.578088 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.579327 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.579528 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.579602 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.579817 (+ 215us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 04:51:04.612686 (+ 32869us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 04:51:04.612920 (+ 234us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47018: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 04:51:04.613129 25131 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47018: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 04:51:04.613303 25162 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:04.576877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39787 (local address 127.0.0.1:47018)
0810 04:51:04.577081 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:04.577096 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:04.577181 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:04.577383 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:04.577384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:04.577387 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0810 04:51:04.577467 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:04.577471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.578180 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.578182 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:04.579220 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:04.579224 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:04.579621 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:04.579623 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:04.579696 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:04.579705 (+ 9us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 04:51:04.612973 (+ 33268us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 04:51:04.613179 (+ 206us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.239.254:39787: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":110,"threads_started":1}
I20260810 04:51:04.613795 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 25003
2026-08-10T04:51:04Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (246 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (108 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (106 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:04 dist-test-slave-kvfs krb5kdc[25184](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:04 dist-test-slave-kvfs krb5kdc[25184](info): set up 2 sockets
Aug 10 04:51:04 dist-test-slave-kvfs krb5kdc[25184](info): commencing operation
krb5kdc: starting...
W20260810 04:51:06.171437 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:51:06.315419 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36721
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:44925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:06.413196 25200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:06.413463 25200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:06.413488 25200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:06.414805 25200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:06.414850 25200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:06.414865 25200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:06.414877 25200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:06.414889 25200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:06.416611 25200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:06.416927 25200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:06.417209 25200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:06.422919 25214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:06.422935 25200 server_base.cc:1034] running on GCE node
W20260810 04:51:06.422902 25211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:06.422891 25210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:06.423501 25200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:06.423918 25200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:06.425101 25200 hybrid_clock.cc:648] HybridClock initialized: now 1786337466425104 us; error 72 us; skew 500 ppm
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:06.428313 25200 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:51:06.428874 25200 webserver.cc:460] Webserver started at http://127.15.239.254:38645/ using document root <none> and password file <none>
I20260810 04:51:06.429173 25200 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:06.429248 25200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:06.429420 25200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:06.430660 25200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "1e3d1ea52b0c499ea3fc45537deca862"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "b84f5cba93d4d623bb0c9bff2eeea19f"
server_key_iv: "73b0debefa55a69c5c3eaac2023abc6a"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.431087 25200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "1e3d1ea52b0c499ea3fc45537deca862"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "b84f5cba93d4d623bb0c9bff2eeea19f"
server_key_iv: "73b0debefa55a69c5c3eaac2023abc6a"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.432931 25200 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260810 04:51:06.433858 25226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.434082 25200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:06.434209 25200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "1e3d1ea52b0c499ea3fc45537deca862"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "b84f5cba93d4d623bb0c9bff2eeea19f"
server_key_iv: "73b0debefa55a69c5c3eaac2023abc6a"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.434296 25200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:06.446517 25200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:06.449303 25200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:06.449504 25200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:06.454891 25200 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:36721
I20260810 04:51:06.454968 25316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:36721 every 8 connection(s)
I20260810 04:51:06.455426 25200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:06.456634 25321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:06.459522 25321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862: Bootstrap starting.
I20260810 04:51:06.460328 25321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:06.460693 25321 log.cc:824] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:06.461504 25321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862: No bootstrap required, opened a new log
I20260810 04:51:06.462466 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 25200
I20260810 04:51:06.462582 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:06.462802 16319 external_mini_cluster.cc:1428] Setting key 92657690b9fefc099126b1d504c48bb5
I20260810 04:51:06.464082 25321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d1ea52b0c499ea3fc45537deca862" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36721 } }
I20260810 04:51:06.464298 25321 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:06.464344 25321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3d1ea52b0c499ea3fc45537deca862, State: Initialized, Role: FOLLOWER
I20260810 04:51:06.464560 25321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d1ea52b0c499ea3fc45537deca862" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36721 } }
I20260810 04:51:06.464664 25321 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:06.464700 25321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:06.464761 25321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:06.465971 25321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d1ea52b0c499ea3fc45537deca862" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36721 } }
I20260810 04:51:06.466076 25321 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3d1ea52b0c499ea3fc45537deca862; no voters:
I20260810 04:51:06.466284 25321 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:06.466333 25332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:06.466536 25332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3d1ea52b0c499ea3fc45537deca862, State: Running, Role: LEADER
I20260810 04:51:06.466652 25321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:06.466681 25332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d1ea52b0c499ea3fc45537deca862" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36721 } }
I20260810 04:51:06.467095 25332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3d1ea52b0c499ea3fc45537deca862. Latest consensus state: current_term: 1 leader_uuid: "1e3d1ea52b0c499ea3fc45537deca862" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d1ea52b0c499ea3fc45537deca862" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36721 } } }
I20260810 04:51:06.467108 25333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e3d1ea52b0c499ea3fc45537deca862" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d1ea52b0c499ea3fc45537deca862" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36721 } } }
I20260810 04:51:06.467258 25333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:06.467468 25332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:06.467703 25345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:06.468353 25345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:06.470393 25345 catalog_manager.cc:1347] Generated new cluster ID: baebcda785344741ab8ef6848feedd10
I20260810 04:51:06.470669 25345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:06.476136 25331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:06.463626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37162 (local address 127.15.239.254:36721)
0810 04:51:06.463862 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:06.463872 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:06.463903 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:51:06.464063 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:06.464070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:06.464121 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:06.464260 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:06.465241 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.466503 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.467712 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.468389 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.468915 (+ 526us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:06.471790 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:06.471795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:06.471795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:06.471809 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:06.474184 (+ 2375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:06.474593 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:06.474597 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:06.474597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:06.474740 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:06.474972 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:06.474973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:06.474973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:06.475359 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:06.475546 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:06.475630 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 04:51:06.475798 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":109,"threads_started":1}
I20260810 04:51:06.513116 25345 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:06.514068 25345 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:06.521653 25345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3d1ea52b0c499ea3fc45537deca862: Generated new TSK 0
I20260810 04:51:06.521958 25345 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:51:06.560389 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36721
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:44925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:06.659420 25364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:06.659730 25364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:06.659772 25364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:06.661043 25364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:06.661115 25364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:06.661158 25364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:06.662760 25364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:06.663082 25364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:06.663368 25364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:06.669670 25378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:06.669714 25381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:06.669693 25379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:06.669736 25364 server_base.cc:1034] running on GCE node
I20260810 04:51:06.670260 25364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:06.670511 25364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:06.671694 25364 hybrid_clock.cc:648] HybridClock initialized: now 1786337466671672 us; error 42 us; skew 500 ppm
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:06.675141 25364 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:51:06.675747 25364 webserver.cc:460] Webserver started at http://127.15.239.193:44745/ using document root <none> and password file <none>
I20260810 04:51:06.676098 25364 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:06.676185 25364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:06.676383 25364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:06.677711 25364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "474efd9269bf4bfdb3131878b9d0a6a7"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "7951e549a83594c5ebafdd0d07d4d9ef"
server_key_iv: "6ed8036e64231bc4992e92b2f4f63e31"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.678189 25364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "474efd9269bf4bfdb3131878b9d0a6a7"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "7951e549a83594c5ebafdd0d07d4d9ef"
server_key_iv: "6ed8036e64231bc4992e92b2f4f63e31"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.679972 25364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 04:51:06.681054 25389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.681294 25364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:06.681433 25364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "474efd9269bf4bfdb3131878b9d0a6a7"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "7951e549a83594c5ebafdd0d07d4d9ef"
server_key_iv: "6ed8036e64231bc4992e92b2f4f63e31"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.681520 25364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:06.698585 25364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:06.701606 25364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:06.701805 25364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:06.702140 25364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:06.702528 25364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:06.702591 25364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.702636 25364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:06.702665 25364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.709560 25364 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:33689
I20260810 04:51:06.709607 25585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:33689 every 8 connection(s)
I20260810 04:51:06.710022 25364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:06.719489 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 25364
I20260810 04:51:06.719622 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:06.719897 16319 external_mini_cluster.cc:1428] Setting key 537bcf63821fbeefc185f7272dfef3c5
I20260810 04:51:06.721966 25331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:06.710995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:48141 (local address 127.15.239.254:36721)
0810 04:51:06.711082 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:06.711086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:06.711341 (+ 255us) server_negotiation.cc:407] Connection header received
0810 04:51:06.712494 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:06.712495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:06.712514 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:06.712586 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:06.713371 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.714023 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.715153 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.715413 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.715486 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:06.718315 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:06.718317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:06.718318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:06.718329 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:06.720218 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:06.720706 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:06.720708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:06.720708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:06.720803 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:06.721131 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:06.721133 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:06.721133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:06.721304 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:06.721383 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:06.721677 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 04:51:06.721796 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:51:06.722005 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:06.710970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36721 (local address 127.15.239.193:48141)
0810 04:51:06.711195 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:06.711240 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:06.712354 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:06.712655 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:06.712659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:06.712992 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:06.713241 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:06.713246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.714138 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.714139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:06.715047 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:06.715050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.715526 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.715527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:06.715669 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:06.716297 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:06.716308 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:06.718208 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:06.720327 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:06.720336 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:06.720340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:06.720608 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:06.720891 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:06.720892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:06.720893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:06.721046 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:06.721377 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:06.721384 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:06.721531 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 04:51:06.721627 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:51:06.721781 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":125,"threads_started":1}
I20260810 04:51:06.723654 25587 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36721
I20260810 04:51:06.723804 25587 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:06.724083 25587 heartbeater.cc:511] Master 127.15.239.254:36721 requested a full tablet report, sending...
I20260810 04:51:06.724843 25257 ts_manager.cc:194] Registered new tserver with Master: 474efd9269bf4bfdb3131878b9d0a6a7 (127.15.239.193:33689)
I20260810 04:51:06.725605 25257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:48141
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:51:06.751842 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36721
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:44925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:06.849375 25593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:06.849653 25593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:06.849679 25593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:06.850991 25593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:06.851045 25593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:06.851075 25593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:06.852813 25593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:06.853127 25593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:06.853435 25593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:06.859444 25602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:06.859495 25603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:06.859547 25593 server_base.cc:1034] running on GCE node
W20260810 04:51:06.859444 25606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:06.860092 25593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:06.860459 25593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:06.861666 25593 hybrid_clock.cc:648] HybridClock initialized: now 1786337466861653 us; error 46 us; skew 500 ppm
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:06.864923 25593 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:51:06.865525 25593 webserver.cc:460] Webserver started at http://127.15.239.194:38471/ using document root <none> and password file <none>
I20260810 04:51:06.865789 25593 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:06.865862 25593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:06.866086 25593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:06.867458 25593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "fbbf1e30293a41b49bb0bc93cbd577c3"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "021e027957f57737f59a835002e3ba01"
server_key_iv: "5e1d30e81e43c56e30a7dab059955259"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.867901 25593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "fbbf1e30293a41b49bb0bc93cbd577c3"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "021e027957f57737f59a835002e3ba01"
server_key_iv: "5e1d30e81e43c56e30a7dab059955259"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.869534 25593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:06.870400 25615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.870606 25593 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:06.870734 25593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "fbbf1e30293a41b49bb0bc93cbd577c3"
format_stamp: "Formatted at 2026-08-10 04:51:06 on dist-test-slave-kvfs"
server_key: "021e027957f57737f59a835002e3ba01"
server_key_iv: "5e1d30e81e43c56e30a7dab059955259"
server_key_version: "encryptionkey@0"
I20260810 04:51:06.870818 25593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:06.887324 25593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:06.889832 25593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:06.890029 25593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:06.890345 25593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:06.890751 25593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:06.890813 25593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.890863 25593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:06.890888 25593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:06.898228 25593 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:34311
I20260810 04:51:06.898286 25795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:34311 every 8 connection(s)
I20260810 04:51:06.898705 25593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:06.900220 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 25593
I20260810 04:51:06.900378 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:06.900619 16319 external_mini_cluster.cc:1428] Setting key 283428537ddf5d1ddfb0a97a28c9902b
Aug 10 04:51:06 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337466, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:06.912159 25331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:06.900116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:50171 (local address 127.15.239.254:36721)
0810 04:51:06.900187 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:06.900191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:06.900208 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:51:06.901691 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:06.901693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:06.901710 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:06.901742 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:06.902638 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.903525 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.905121 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.905342 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.905423 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:06.908363 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:06.908366 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:06.908366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:06.908376 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:06.910242 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:06.910796 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:06.910801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:06.910802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:06.910881 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:06.911229 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:06.911230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:06.911231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:06.911413 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:06.911502 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:06.911865 (+ 363us) server_negotiation.cc:299] Negotiation successful
0810 04:51:06.911992 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:51:06.912317 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:06.899681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36721 (local address 127.15.239.194:50171)
0810 04:51:06.899917 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:06.899984 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:06.901542 (+ 1558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:06.901951 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:06.901956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:06.902267 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:06.902522 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:06.902525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.903646 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.903647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:06.905006 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:06.905012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:06.905443 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:06.905444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:06.905616 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:06.906281 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:06.906291 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:06.908259 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:06.910345 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:06.910353 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:06.910355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:06.910679 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:06.910991 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:06.910992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:06.910992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:06.911137 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:06.911516 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:06.911523 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:06.911690 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 04:51:06.911794 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 04:51:06.911953 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
I20260810 04:51:06.913035 25797 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36721
I20260810 04:51:06.913178 25797 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:06.913465 25797 heartbeater.cc:511] Master 127.15.239.254:36721 requested a full tablet report, sending...
I20260810 04:51:06.914063 25257 ts_manager.cc:194] Registered new tserver with Master: fbbf1e30293a41b49bb0bc93cbd577c3 (127.15.239.194:34311)
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
I20260810 04:51:06.914680 25257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:50171
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:51:06.940092 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36721
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:44925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:07.041921 25806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:07.042203 25806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:07.042233 25806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:07.043553 25806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:07.043593 25806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:07.043619 25806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:07.045213 25806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:07.045452 25806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:07.045691 25806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:07.051738 25818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:07.051721 25815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:07.051721 25813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:07.051993 25806 server_base.cc:1034] running on GCE node
I20260810 04:51:07.052388 25806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:07.052667 25806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:07.053848 25806 hybrid_clock.cc:648] HybridClock initialized: now 1786337467053824 us; error 48 us; skew 500 ppm
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.056908 25806 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:51:07.057492 25806 webserver.cc:460] Webserver started at http://127.15.239.195:36895/ using document root <none> and password file <none>
I20260810 04:51:07.057802 25806 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:07.057884 25806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:07.058056 25806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:07.059342 25806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "0872104129f54bc483d727635857a817"
format_stamp: "Formatted at 2026-08-10 04:51:07 on dist-test-slave-kvfs"
server_key: "af3d055566ecd057c0def1a420b71de9"
server_key_iv: "879e4c23b13fced4aaa3fa1777ba2412"
server_key_version: "encryptionkey@0"
I20260810 04:51:07.059774 25806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "0872104129f54bc483d727635857a817"
format_stamp: "Formatted at 2026-08-10 04:51:07 on dist-test-slave-kvfs"
server_key: "af3d055566ecd057c0def1a420b71de9"
server_key_iv: "879e4c23b13fced4aaa3fa1777ba2412"
server_key_version: "encryptionkey@0"
I20260810 04:51:07.061419 25806 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 04:51:07.062264 25825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:07.062472 25806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:07.062594 25806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "0872104129f54bc483d727635857a817"
format_stamp: "Formatted at 2026-08-10 04:51:07 on dist-test-slave-kvfs"
server_key: "af3d055566ecd057c0def1a420b71de9"
server_key_iv: "879e4c23b13fced4aaa3fa1777ba2412"
server_key_version: "encryptionkey@0"
I20260810 04:51:07.062687 25806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:07.077605 25806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:07.080305 25806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:07.080500 25806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:07.080832 25806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:07.081241 25806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:07.081300 25806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:07.081341 25806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:07.081388 25806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:07.088768 25806 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:36369
I20260810 04:51:07.088820 26006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:36369 every 8 connection(s)
I20260810 04:51:07.089222 25806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:07.098495 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 25806
I20260810 04:51:07.098583 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:07.098816 16319 external_mini_cluster.cc:1428] Setting key 85172f7f4cc6fa7deaf4db8e0a9d37c3
I20260810 04:51:07.101054 25331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:07.090205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:52761 (local address 127.15.239.254:36721)
0810 04:51:07.090307 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.090310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.090475 (+ 165us) server_negotiation.cc:407] Connection header received
0810 04:51:07.091664 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.091666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.091679 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.091737 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.092611 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.093186 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.094344 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.094550 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.094605 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:07.097227 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:07.097229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:07.097230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:07.097238 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:07.099115 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.099861 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.099863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.099863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.099927 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.100255 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.100256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.100257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.100408 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:07.100504 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:07.100833 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 04:51:07.100949 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 04:51:07.101303 26014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:07.090098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36721 (local address 127.15.239.195:52761)
0810 04:51:07.090303 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:07.090356 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:07.091554 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:07.091811 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:07.091815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:07.092250 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:07.092516 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:07.092522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.093284 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.093284 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:07.094259 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:07.094261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.094632 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.094633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:07.094759 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:07.095375 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:07.095385 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:07.097101 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:07.099314 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:07.099325 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:07.099328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:07.099734 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:07.099995 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:07.099997 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:07.099997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:07.100165 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:07.100496 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:07.100504 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:07.100677 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 04:51:07.100795 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:51:07.100990 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260810 04:51:07.101842 26009 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36721
I20260810 04:51:07.101982 26009 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:07.102237 26009 heartbeater.cc:511] Master 127.15.239.254:36721 requested a full tablet report, sending...
I20260810 04:51:07.102713 25257 ts_manager.cc:194] Registered new tserver with Master: 0872104129f54bc483d727635857a817 (127.15.239.195:36369)
I20260810 04:51:07.103207 25257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:52761
I20260810 04:51:07.111410 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/test-admin.keytab.
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.133176 16319 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 04:51:07.135353 26019 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:07.134397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44564 (local address 127.15.239.193:33689)
0810 04:51:07.134637 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.134643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.134655 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:07.134690 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.134693 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.134710 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.134792 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.135238 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44564: BlockingRecv error: recv got EOF from 127.0.0.1:44564 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":144,"threads_started":1}
W20260810 04:51:07.135619 16319 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc' of type FILE
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.137017 16319 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.138372 16319 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:51:07.148479 26019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:07.139515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44566 (local address 127.15.239.193:33689)
0810 04:51:07.139605 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.139607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.139615 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:07.139650 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.139651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.139668 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.139721 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.140265 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.141376 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.142202 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.142623 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.142715 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:07.145255 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:07.145267 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:07.145267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:07.145282 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:07.147030 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.147453 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.147457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.147458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.147543 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.147772 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.147773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.147773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.147950 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:07.148195 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:07.148245 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 04:51:07.148338 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 04:51:07.150826 26019 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:07.150143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44576 (local address 127.15.239.193:33689)
0810 04:51:07.150183 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.150185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.150316 (+ 131us) server_negotiation.cc:407] Connection header received
0810 04:51:07.150351 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.150352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.150362 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.150411 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.150769 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44576: BlockingRecv error: recv got EOF from 127.0.0.1:44576 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 04:51:07.150902 16319 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc' of type FILE
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.152098 16319 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.153079 16319 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:51:07.160984 26019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:07.153609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44586 (local address 127.15.239.193:33689)
0810 04:51:07.153647 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.153649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.153703 (+ 54us) server_negotiation.cc:407] Connection header received
0810 04:51:07.153771 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.153772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.153780 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.153828 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.154270 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.154826 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.155606 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.155833 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.155900 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:07.158174 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:07.158175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:07.158176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:07.158183 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:07.159781 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.160261 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.160262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.160262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.160318 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.160515 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.160516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.160516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.160608 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:07.160687 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:07.160794 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 04:51:07.160861 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 04:51:07.162966 26019 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:07.162211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44592 (local address 127.15.239.193:33689)
0810 04:51:07.162252 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.162254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.162298 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:51:07.162362 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.162363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.162372 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.162424 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.162908 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44592: BlockingRecv error: recv got EOF from 127.0.0.1:44592 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:51:07.163022 16319 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786337435403234-16319-0/krb5kdc/krb5cc' of type FILE
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.164125 16319 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:07.165014 16319 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[25184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:51:07.173096 26019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:07.165680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.15.239.193:33689)
0810 04:51:07.165738 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:07.165740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:07.165828 (+ 88us) server_negotiation.cc:407] Connection header received
0810 04:51:07.165909 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:07.165910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:07.165920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:07.165990 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:07.166408 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.167033 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.167809 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:07.168117 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:07.168193 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:07.170454 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:07.170456 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:07.170456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:07.170464 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:07.171782 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.172244 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.172246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.172246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.172316 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:07.172532 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:07.172533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:07.172534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:07.172654 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:07.172772 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:07.172904 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 04:51:07.172985 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:51:07.173975 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 25364
I20260810 04:51:07.193068 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 25593
I20260810 04:51:07.206238 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 25806
I20260810 04:51:07.223858 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 25200
2026-08-10T04:51:07Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2390 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[26039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[26039](info): set up 2 sockets
Aug 10 04:51:07 dist-test-slave-kvfs krb5kdc[26039](info): commencing operation
krb5kdc: starting...
W20260810 04:51:08.507231 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:08 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:08Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab.
Entry for principal oryx/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab.
I20260810 04:51:08.652236 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42783
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab
--principal=oryx/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:08.748714 26057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:08.749048 26057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:08.749094 26057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:08.750413 26057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:08.750496 26057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:08.750522 26057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:08.750545 26057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:08.750576 26057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:08.752307 26057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab
--principal=oryx/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:08.752671 26057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:08.752980 26057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:08.759057 26067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:08.759038 26069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:08.759405 26057 server_base.cc:1034] running on GCE node
W20260810 04:51:08.759083 26066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:08.760063 26057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:08.760460 26057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:08.761650 26057 hybrid_clock.cc:648] HybridClock initialized: now 1786337468761624 us; error 48 us; skew 500 ppm
Aug 10 04:51:08 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:08.765058 26057 init.cc:377] Logged in from keytab as oryx/127.15.239.254@KRBTEST.COM (short username oryx)
I20260810 04:51:08.765581 26057 webserver.cc:460] Webserver started at http://127.15.239.254:35237/ using document root <none> and password file <none>
I20260810 04:51:08.765903 26057 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:08.765981 26057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:08.766150 26057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:08.767481 26057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "3c2d0e217274446399735c268b7ea38d"
format_stamp: "Formatted at 2026-08-10 04:51:08 on dist-test-slave-kvfs"
server_key: "ea279fd55a122d9741e0d85b5f6fa01c"
server_key_iv: "8972519e650c98b57f4bedd304084fa4"
server_key_version: "encryptionkey@0"
I20260810 04:51:08.767949 26057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "3c2d0e217274446399735c268b7ea38d"
format_stamp: "Formatted at 2026-08-10 04:51:08 on dist-test-slave-kvfs"
server_key: "ea279fd55a122d9741e0d85b5f6fa01c"
server_key_iv: "8972519e650c98b57f4bedd304084fa4"
server_key_version: "encryptionkey@0"
I20260810 04:51:08.769791 26057 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 04:51:08.770790 26079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:08.771046 26057 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:08.771189 26057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "3c2d0e217274446399735c268b7ea38d"
format_stamp: "Formatted at 2026-08-10 04:51:08 on dist-test-slave-kvfs"
server_key: "ea279fd55a122d9741e0d85b5f6fa01c"
server_key_iv: "8972519e650c98b57f4bedd304084fa4"
server_key_version: "encryptionkey@0"
I20260810 04:51:08.771286 26057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:08.806137 26057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:08.809132 26057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:08.809342 26057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:08.814754 26057 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:42783
I20260810 04:51:08.814818 26162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:42783 every 8 connection(s)
I20260810 04:51:08.815303 26057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:08.816818 26163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:08.819928 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 26057
I20260810 04:51:08.819973 26163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Bootstrap starting.
I20260810 04:51:08.820124 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:08.820348 16319 external_mini_cluster.cc:1428] Setting key c00db5ff703807bd6bcaf27175458a36
I20260810 04:51:08.820906 26163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:08.821359 26163 log.cc:824] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:08.822362 26163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: No bootstrap required, opened a new log
I20260810 04:51:08.825148 26163 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } }
I20260810 04:51:08.825371 26163 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:08.825409 26163 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c2d0e217274446399735c268b7ea38d, State: Initialized, Role: FOLLOWER
I20260810 04:51:08.825558 26163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } }
I20260810 04:51:08.825657 26163 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:08.825699 26163 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:08.825824 26163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:08.826694 26163 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } }
I20260810 04:51:08.826851 26163 leader_election.cc:302] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c2d0e217274446399735c268b7ea38d; no voters:
I20260810 04:51:08.827104 26163 leader_election.cc:288] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:08.827272 26171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:08.827456 26163 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:08.827572 26171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 LEADER]: Becoming Leader. State: Replica: 3c2d0e217274446399735c268b7ea38d, State: Running, Role: LEADER
I20260810 04:51:08.827773 26171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } }
I20260810 04:51:08.828567 26173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } }
I20260810 04:51:08.828675 26173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:08.828905 26175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c2d0e217274446399735c268b7ea38d. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } }
I20260810 04:51:08.828979 26175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
Aug 10 04:51:08 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:08.829274 26183 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:08.830255 26183 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:08.832877 26183 catalog_manager.cc:1347] Generated new cluster ID: 4ca2dc32422b46eca18819d9e8ca34eb
I20260810 04:51:08.832958 26183 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:08.834791 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:08.821145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56010 (local address 127.15.239.254:42783)
0810 04:51:08.821461 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:08.821474 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:08.821521 (+ 47us) server_negotiation.cc:407] Connection header received
0810 04:51:08.822224 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:08.822236 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:08.822301 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:08.822510 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:08.823511 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:08.824613 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:08.825745 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:08.826311 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:08.826420 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:08.830062 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:08.830068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:08.830068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:08.830083 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:08.832908 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:08.833382 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:08.833385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:08.833386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:08.833482 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:08.833712 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:08.833713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:08.833714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:08.834005 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:08.834232 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:08.834308 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 04:51:08.834469 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":138,"threads_started":1}
I20260810 04:51:08.856169 26183 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:08.856870 26183 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:08.861455 26183 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Generated new TSK 0
I20260810 04:51:08.861680 26183 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab.
Entry for principal oryx/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab.
I20260810 04:51:08.904366 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42783
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:09.005719 26200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:09.006009 26200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:09.006036 26200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:09.007238 26200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:09.007275 26200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:09.007302 26200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:09.009027 26200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:09.009269 26200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:09.009577 26200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:09.016137 26207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.016160 26206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.016165 26210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:09.016307 26200 server_base.cc:1034] running on GCE node
I20260810 04:51:09.016695 26200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:09.016985 26200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:09.018131 26200 hybrid_clock.cc:648] HybridClock initialized: now 1786337469018112 us; error 43 us; skew 500 ppm
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:09.021153 26200 init.cc:377] Logged in from keytab as oryx/127.15.239.193@KRBTEST.COM (short username oryx)
I20260810 04:51:09.021713 26200 webserver.cc:460] Webserver started at http://127.15.239.193:36453/ using document root <none> and password file <none>
I20260810 04:51:09.021987 26200 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:09.022061 26200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:09.022223 26200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:09.023437 26200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "34954b6eebeb4687862b4fb18190333e"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "5b7e401be046f863fc433299116bfcd3"
server_key_iv: "00bd33211b9695e01382f8f807256de2"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.023859 26200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "34954b6eebeb4687862b4fb18190333e"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "5b7e401be046f863fc433299116bfcd3"
server_key_iv: "00bd33211b9695e01382f8f807256de2"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.025440 26200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:09.026332 26220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.026641 26200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:09.026767 26200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "34954b6eebeb4687862b4fb18190333e"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "5b7e401be046f863fc433299116bfcd3"
server_key_iv: "00bd33211b9695e01382f8f807256de2"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.026881 26200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:09.042460 26200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:09.045109 26200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:09.045306 26200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:09.045616 26200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:09.046025 26200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:09.046085 26200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.046131 26200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:09.046178 26200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.053490 26200 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:32965
I20260810 04:51:09.053550 26399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:32965 every 8 connection(s)
I20260810 04:51:09.053973 26200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:09.062564 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 26200
I20260810 04:51:09.062695 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:09.063004 16319 external_mini_cluster.cc:1428] Setting key 71546a31ca6cd249d66918b33b41d6f9
I20260810 04:51:09.066360 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.055089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:33335 (local address 127.15.239.254:42783)
0810 04:51:09.055163 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.055166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.055449 (+ 283us) server_negotiation.cc:407] Connection header received
0810 04:51:09.056295 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.056297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.056309 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.056391 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.057638 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.058237 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.059426 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.059661 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.059739 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.062586 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.062589 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.062589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.062600 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.064598 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.065190 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.065191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.065191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.065254 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.065591 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.065592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.065592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.065715 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.065768 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.066169 (+ 401us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.066258 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:51:09.066751 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.055013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:33335)
0810 04:51:09.055272 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.055328 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.056178 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.056468 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.056473 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.057227 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.057501 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.057507 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.058333 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.058334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.059307 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.059310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.059777 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.059778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.059946 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.060677 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.060687 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.062458 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.064686 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.064695 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.064698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.065106 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.065330 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.065331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.065331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.065520 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.065785 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.065794 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.066008 (+ 214us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.066141 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.066373 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":144,"threads_started":1}
I20260810 04:51:09.067430 26401 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42783
I20260810 04:51:09.067586 26401 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:09.067832 26401 heartbeater.cc:511] Master 127.15.239.254:42783 requested a full tablet report, sending...
I20260810 04:51:09.068595 26105 ts_manager.cc:194] Registered new tserver with Master: 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965)
I20260810 04:51:09.069301 26105 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:33335
WARNING: no policy specified for oryx/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab.
Entry for principal oryx/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab.
I20260810 04:51:09.100875 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42783
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:09.199841 26408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:09.200181 26408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:09.200223 26408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:09.201740 26408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:09.201853 26408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:09.201906 26408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:09.203545 26408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:09.203951 26408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:09.204308 26408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:09.210268 26418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.210312 26415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.210286 26416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:09.210573 26408 server_base.cc:1034] running on GCE node
I20260810 04:51:09.210799 26408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:09.211113 26408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:09.212284 26408 hybrid_clock.cc:648] HybridClock initialized: now 1786337469212273 us; error 45 us; skew 500 ppm
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:09.215232 26408 init.cc:377] Logged in from keytab as oryx/127.15.239.194@KRBTEST.COM (short username oryx)
I20260810 04:51:09.215739 26408 webserver.cc:460] Webserver started at http://127.15.239.194:38811/ using document root <none> and password file <none>
I20260810 04:51:09.216001 26408 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:09.216125 26408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:09.216296 26408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:09.217530 26408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "bc902a77ff01450887bfe1a32d856db8"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "cc77af10ca330c36abb383ce232caf65"
server_key_iv: "25d21208ee4aaf4b621fbc4a6a603739"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.217953 26408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "bc902a77ff01450887bfe1a32d856db8"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "cc77af10ca330c36abb383ce232caf65"
server_key_iv: "25d21208ee4aaf4b621fbc4a6a603739"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.219436 26408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:51:09.220361 26428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.220542 26408 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:09.220661 26408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "bc902a77ff01450887bfe1a32d856db8"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "cc77af10ca330c36abb383ce232caf65"
server_key_iv: "25d21208ee4aaf4b621fbc4a6a603739"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.220744 26408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:09.231873 26408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:09.234226 26408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:09.234413 26408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:09.234712 26408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:09.235100 26408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:09.235158 26408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.235198 26408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:09.235245 26408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.242897 26408 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:37471
I20260810 04:51:09.243486 26408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:09.243495 26617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:37471 every 8 connection(s)
I20260810 04:51:09.249533 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 26408
I20260810 04:51:09.249673 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:09.249950 16319 external_mini_cluster.cc:1428] Setting key e65d853ae019261c8199a9e40906854f
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:09.259480 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.245878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:34649 (local address 127.15.239.254:42783)
0810 04:51:09.245945 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.245947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.245961 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:51:09.246466 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.246469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.246485 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.246546 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.248188 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.249180 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.251214 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.251519 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.251574 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.254933 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.254935 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.254935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.254945 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.257388 (+ 2443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.258033 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.258035 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.258035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.258121 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.258492 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.258494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.258495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.258697 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.258788 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.259216 (+ 428us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.259339 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:51:09.259742 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.245015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:34649)
0810 04:51:09.245267 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.245356 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.246337 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.246634 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.246639 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.247656 (+ 1017us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.248056 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.248066 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.249485 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.249487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.251098 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.251101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.251693 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.251694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.251874 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.252617 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.252631 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.254788 (+ 2157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.257491 (+ 2703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.257501 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.257505 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.257919 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.258223 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.258224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.258224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.258402 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.258790 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.258800 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.259028 (+ 228us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.259176 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.259411 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":115,"threads_started":1}
I20260810 04:51:09.260507 26619 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42783
I20260810 04:51:09.260673 26619 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:09.260965 26619 heartbeater.cc:511] Master 127.15.239.254:42783 requested a full tablet report, sending...
I20260810 04:51:09.261584 26105 ts_manager.cc:194] Registered new tserver with Master: bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471)
I20260810 04:51:09.262188 26105 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:34649
WARNING: no policy specified for oryx/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab.
Entry for principal oryx/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab.
I20260810 04:51:09.291442 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42783
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:09.389796 26627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:09.390118 26627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:09.390163 26627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:09.391474 26627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:09.391558 26627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:09.391618 26627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:09.393286 26627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:09.393631 26627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:09.393935 26627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:09.399977 26638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.399916 26634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.399922 26633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:09.400414 26627 server_base.cc:1034] running on GCE node
I20260810 04:51:09.400703 26627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:09.401005 26627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:09.402223 26627 hybrid_clock.cc:648] HybridClock initialized: now 1786337469402204 us; error 39 us; skew 500 ppm
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:09.405824 26627 init.cc:377] Logged in from keytab as oryx/127.15.239.195@KRBTEST.COM (short username oryx)
I20260810 04:51:09.407629 26627 webserver.cc:460] Webserver started at http://127.15.239.195:42783/ using document root <none> and password file <none>
I20260810 04:51:09.407968 26627 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:09.408087 26627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:09.408231 26627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:09.409590 26627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "703146d8d6943d8d96888421970f7ee8"
server_key_iv: "7a4cf86972d323276c905622ecb19529"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.409950 26627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "703146d8d6943d8d96888421970f7ee8"
server_key_iv: "7a4cf86972d323276c905622ecb19529"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.411438 26627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 04:51:09.412321 26651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.412528 26627 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:09.412638 26627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "703146d8d6943d8d96888421970f7ee8"
server_key_iv: "7a4cf86972d323276c905622ecb19529"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.412725 26627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:09.420948 26627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:09.423393 26627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:09.423578 26627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:09.423879 26627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:09.424309 26627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:09.424371 26627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.424425 26627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:09.424453 26627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.431660 26627 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:38749
I20260810 04:51:09.431744 26829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:38749 every 8 connection(s)
I20260810 04:51:09.432190 26627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:09.439775 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 26627
I20260810 04:51:09.440008 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:09.440301 16319 external_mini_cluster.cc:1428] Setting key 5a1b6cf2fcbe17a7bca2ae0bbd2554c2
I20260810 04:51:09.443534 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.433076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:55379 (local address 127.15.239.254:42783)
0810 04:51:09.433154 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.433156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.433396 (+ 240us) server_negotiation.cc:407] Connection header received
0810 04:51:09.434057 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.434059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.434074 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.434143 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.435244 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.435832 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.437056 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.437294 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.437382 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.440181 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.440183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.440183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.440192 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.441919 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.442386 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.442387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.442388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.442468 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.442750 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.442751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.442751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.442909 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.442988 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.443313 (+ 325us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.443418 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:51:09.443789 26833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.433040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:55379)
0810 04:51:09.433242 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.433291 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.433930 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.434228 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.434232 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.434899 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.435131 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.435135 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.435956 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.435957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.436952 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.436954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.437386 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.437387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.437543 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.438115 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.438125 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.440063 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.442006 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.442016 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.442019 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.442302 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.442541 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.442542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.442543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.442678 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.442986 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.442995 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.443169 (+ 174us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.443293 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.443503 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":103,"threads_started":1}
I20260810 04:51:09.444432 26831 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42783
I20260810 04:51:09.444581 26831 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:09.444823 26831 heartbeater.cc:511] Master 127.15.239.254:42783 requested a full tablet report, sending...
I20260810 04:51:09.445330 26105 ts_manager.cc:194] Registered new tserver with Master: 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195:38749)
I20260810 04:51:09.445772 26105 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:55379
I20260810 04:51:09.452836 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.239.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.253.keytab.
Entry for principal oryx/127.15.239.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.253.keytab.
I20260810 04:51:09.488106 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:34601
--webserver_interface=127.15.239.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.253.keytab
--principal=oryx/127.15.239.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42783,127.15.239.253:34601
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:09.587932 26837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:09.588238 26837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:09.588263 26837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:09.589493 26837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:09.589540 26837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:09.589553 26837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:09.589566 26837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:09.589578 26837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:09.591151 26837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42783,127.15.239.253:34601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.253.keytab
--principal=oryx/127.15.239.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:34601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.239.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
W20260810 04:51:09.591298 26837 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.239.254:42783,127.15.239.253:34601'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 04:51:09.591478 26837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:09.591755 26837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:09.597388 26844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.597431 26846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.597431 26848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:09.597604 26837 server_base.cc:1034] running on GCE node
I20260810 04:51:09.597887 26837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:09.598259 26837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:09.599439 26837 hybrid_clock.cc:648] HybridClock initialized: now 1786337469599429 us; error 51 us; skew 500 ppm
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:09.602612 26837 init.cc:377] Logged in from keytab as oryx/127.15.239.253@KRBTEST.COM (short username oryx)
I20260810 04:51:09.603168 26837 webserver.cc:460] Webserver started at http://127.15.239.253:43053/ using document root <none> and password file <none>
I20260810 04:51:09.603499 26837 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:09.603585 26837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:09.603770 26837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:09.605223 26837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/instance:
uuid: "50405d6f5abb4adea5dd522681e9cd54"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "856d4570bc6c9229bb5005f2f0cf3a4d"
server_key_iv: "a230bdef1df4e71e08f47d56b816d7a4"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.605701 26837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal/instance:
uuid: "50405d6f5abb4adea5dd522681e9cd54"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "856d4570bc6c9229bb5005f2f0cf3a4d"
server_key_iv: "a230bdef1df4e71e08f47d56b816d7a4"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.607386 26837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:51:09.608335 26858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.608556 26837 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:09.608697 26837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
uuid: "50405d6f5abb4adea5dd522681e9cd54"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "856d4570bc6c9229bb5005f2f0cf3a4d"
server_key_iv: "a230bdef1df4e71e08f47d56b816d7a4"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.608788 26837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:09.650854 26837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:09.653716 26837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:09.653960 26837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:09.659504 26837 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.253:34601
I20260810 04:51:09.659535 26935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.253:34601 every 8 connection(s)
I20260810 04:51:09.660111 26837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
I20260810 04:51:09.661412 26936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:09.663391 26936 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:51:09.666723 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 26837
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.253@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
I20260810 04:51:09.675217 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.664297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56022 (local address 127.15.239.254:42783)
0810 04:51:09.664381 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.664385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.664660 (+ 275us) server_negotiation.cc:407] Connection header received
0810 04:51:09.665213 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.665215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.665229 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.665288 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.665976 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.666636 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.668150 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.668359 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.668420 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.671553 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.671556 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.671556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.671568 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.673235 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.673860 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.673862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.673862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.673937 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.674217 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.674218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.674219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.674519 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.674607 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.674977 (+ 370us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.675087 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:51:09.675506 26938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.664278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:56022)
0810 04:51:09.664519 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.664564 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.665102 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.665355 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.665359 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.665653 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.665889 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.665893 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.666742 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.666743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.668068 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.668071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.668446 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.668447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.668615 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.669279 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.669289 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.671430 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.673329 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.673338 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.673341 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.673728 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.674014 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.674015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.674015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.674142 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.674608 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.674616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.674810 (+ 194us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.674963 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.675190 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":137,"threads_started":1}
I20260810 04:51:09.676330 26936 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:51:09.678195 26940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.667431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.15.239.253:34601)
0810 04:51:09.667660 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.667665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.667701 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:51:09.667721 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.667723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.667743 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.667803 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.668659 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.669367 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.670396 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.670958 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.671040 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.674332 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.674338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.674339 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.674345 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.676783 (+ 2438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.677215 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.677219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.677219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.677289 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.677517 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.677518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.677519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.677687 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.677912 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.677962 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.678064 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":189,"thread_start_us":159,"threads_started":1}
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.253@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
I20260810 04:51:09.684288 26938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.676667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:55166)
0810 04:51:09.676873 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.676885 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.676940 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.677093 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.677094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.677232 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.677285 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.677287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.677964 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.677965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.678622 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.678624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.679100 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.679101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.679168 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.679516 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.679520 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.680792 (+ 1272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.683127 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.683128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.683129 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.683304 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.683549 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.683550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.683550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.683619 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.683907 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.683908 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.683948 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.684030 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.684161 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189}
I20260810 04:51:09.684343 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.676719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.15.239.253:34601)
0810 04:51:09.676892 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.676894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.676922 (+ 28us) server_negotiation.cc:407] Connection header received
0810 04:51:09.677003 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.677004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.677014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.677091 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.677371 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.677878 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.678713 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.679017 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.679102 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.680889 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.680890 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.680891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.680897 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.683008 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.683409 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.683410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.683411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.683476 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.683686 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.683687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.683687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.683819 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.683916 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.684081 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.684219 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":152,"thread_start_us":116,"threads_started":1}
I20260810 04:51:09.686153 26936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Bootstrap starting.
I20260810 04:51:09.686956 26936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:09.687238 26936 log.cc:824] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:09.688241 26936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: No bootstrap required, opened a new log
I20260810 04:51:09.689945 26936 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } }
I20260810 04:51:09.690112 26936 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:09.690138 26936 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50405d6f5abb4adea5dd522681e9cd54, State: Initialized, Role: FOLLOWER
I20260810 04:51:09.690296 26936 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } }
I20260810 04:51:09.690649 26944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } } }
I20260810 04:51:09.690748 26936 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:09.690752 26944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:51:09.692849 26967 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:51:09.692945 26967 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:51:09.694885 26837 master_runner.cc:428] Detected that this master 50405d6f5abb4adea5dd522681e9cd54 is joining an existing cluster
I20260810 04:51:09.694940 26837 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.239.253:34601
I20260810 04:51:09.704419 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.696503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56034 (local address 127.15.239.254:42783)
0810 04:51:09.696587 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.696589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.696598 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:51:09.696624 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.696624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.696635 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.696713 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.697206 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.698092 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.699241 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.699451 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.699559 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.700970 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.700972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.700972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.700981 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.702820 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.703362 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.703364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.703364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.703447 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.703694 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.703696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.703696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.703865 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.703970 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.704204 (+ 234us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.704306 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:51:09.704437 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.696250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:56034)
0810 04:51:09.696488 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.696501 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.696567 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.696719 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.696721 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.697046 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.697125 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.697128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.698181 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.698182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.699144 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.699146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.699590 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.699591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.699663 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.700322 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.700328 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.700850 (+ 522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.702936 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.702938 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.702938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.703257 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.703544 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.703545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.703546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.703616 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.703960 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.703961 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.704053 (+ 92us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.704157 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.704290 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"spinlock_wait_cycles":12544,"thread_start_us":161,"threads_started":1}
I20260810 04:51:09.704891 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.696301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55176 (local address 127.15.239.253:34601)
0810 04:51:09.696365 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.696367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.696708 (+ 341us) server_negotiation.cc:407] Connection header received
0810 04:51:09.696799 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.696799 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.696811 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.696897 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.697345 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.698086 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.700273 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.700502 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.700592 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.701798 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.701799 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.701799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.701806 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.703394 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.703807 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.703808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.703809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.703875 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.704100 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.704101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.704102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.704232 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.704296 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.704460 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.704779 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:51:09.705179 26980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.696253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:55176)
0810 04:51:09.696651 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.696659 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.696727 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.696918 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.696919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.697173 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.697247 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.697249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.699251 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.699252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.700143 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.700146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.700591 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.700592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.700658 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.701312 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.701318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.701693 (+ 375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.703510 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.703511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.703511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.703723 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.703949 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.703949 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.703949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.704012 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.704319 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.704319 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.704362 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.704978 (+ 616us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.705084 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":159,"threads_started":1}
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.254@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
I20260810 04:51:09.717054 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.707745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55192 (local address 127.15.239.253:34601)
0810 04:51:09.707796 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.707798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.708114 (+ 316us) server_negotiation.cc:407] Connection header received
0810 04:51:09.708193 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.708194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.708205 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.708255 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.708903 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.709487 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.710734 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.710952 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.711023 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.713935 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.713938 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.713938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.713947 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.715572 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.716126 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.716128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.716128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.716204 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.716423 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.716424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.716424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.716554 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.716634 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.716843 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.716942 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:51:09.717080 26981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.707709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:55192)
0810 04:51:09.707928 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.707993 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.708113 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.708271 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.708275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.708687 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.708777 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.708780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.709573 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.709575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.710630 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.710633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.711040 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.711041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.711147 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.711696 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.711702 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.713801 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.715689 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.715700 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.715703 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.715982 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.716263 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.716264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.716264 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.716346 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.716624 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.716633 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.716699 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.716802 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.716969 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":150,"threads_started":1}
I20260810 04:51:09.718007 26105 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.239.253:34601: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54"
member_type: NON_VOTER
last_known_addr {
host: "127.15.239.253"
port: 34601
}
attrs {
promote: true
}
}
dest_uuid: "3c2d0e217274446399735c268b7ea38d"
cas_config_opid_index: -1
I20260810 04:51:09.718451 26105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } }
I20260810 04:51:09.719132 26982 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } }
I20260810 04:51:09.719527 26894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:09.720642 26982 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.239.253:34601
I20260810 04:51:09.720839 26894 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Refusing update from remote peer 3c2d0e217274446399735c268b7ea38d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 04:51:09.721129 26837 master.cc:537] Master@127.15.239.253:34601 shutting down...
I20260810 04:51:09.721349 26984 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 04:51:09.722267 26083 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260810 04:51:09.722546 26983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } }
I20260810 04:51:09.722643 26983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
W20260810 04:51:09.723716 26083 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d -> Peer 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253:34601): Couldn't send request to peer 50405d6f5abb4adea5dd522681e9cd54. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 04:51:09.724730 26837 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:09.724849 26837 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:09.724917 26837 tablet_replica.cc:330] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: stopping tablet replica
I20260810 04:51:09.739418 26837 master.cc:552] Master@127.15.239.253:34601 shutdown complete.
I20260810 04:51:09.739503 26837 master_runner.cc:305] Clearing existing system tablet
I20260810 04:51:09.739672 26837 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:09.739732 26837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:09.740644 26837 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:09.741289 26992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.741469 26837 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:09.741539 26837 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:09.741565 26837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
uuid: "50405d6f5abb4adea5dd522681e9cd54"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "856d4570bc6c9229bb5005f2f0cf3a4d"
server_key_iv: "a230bdef1df4e71e08f47d56b816d7a4"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.742666 26837 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:09.744561 26837 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 04:51:09.744647 26837 log.cc:1196] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 04:51:09.744887 26837 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Deleting consensus metadata
I20260810 04:51:09.745083 26837 master_runner.cc:315] Copying system tablet from 127.15.239.254:42783
I20260810 04:51:09.745822 26837 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: tablet copy: Beginning tablet copy session from remote peer at address 127.15.239.254:42783
I20260810 04:51:09.753868 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.746384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56050 (local address 127.15.239.254:42783)
0810 04:51:09.746459 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.746461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.746480 (+ 19us) server_negotiation.cc:407] Connection header received
0810 04:51:09.746580 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.746581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.746592 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.746643 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.747115 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.747776 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.748965 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.749190 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.749274 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.750701 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.750703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.750704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.750714 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.752484 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.752954 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.752955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.752956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.753035 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.753263 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.753264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.753264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.753422 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.753486 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.753700 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.753786 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:51:09.753917 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.746242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:56050)
0810 04:51:09.746404 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:09.746418 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:09.746502 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:09.746663 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:09.746664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:09.746932 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:09.747020 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.747023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.747848 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.747850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.748841 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:09.748845 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.749282 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.749283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:09.749367 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.750032 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:09.750038 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:09.750550 (+ 512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:09.752574 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.752576 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.752577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.752835 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.753114 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:09.753115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:09.753115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:09.753194 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:09.753494 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:09.753495 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:09.753554 (+ 59us) client_negotiation.cc:769] Sending connection context
0810 04:51:09.753633 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 04:51:09.753770 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":109,"threads_started":1}
I20260810 04:51:09.754549 26140 tablet_copy_service.cc:140] P 3c2d0e217274446399735c268b7ea38d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 50405d6f5abb4adea5dd522681e9cd54 ({username='oryx', principal='oryx/127.15.239.253@KRBTEST.COM'} at 127.0.0.1:56050)
I20260810 04:51:09.754706 26140 tablet_copy_service.cc:161] P 3c2d0e217274446399735c268b7ea38d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 50405d6f5abb4adea5dd522681e9cd54 at {username='oryx', principal='oryx/127.15.239.253@KRBTEST.COM'} at 127.0.0.1:56050: session id = 50405d6f5abb4adea5dd522681e9cd54-00000000000000000000000000000000
I20260810 04:51:09.755923 26140 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 04:51:09.756913 26837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 04:51:09.758203 26837 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: tablet copy: Starting download of 0 data blocks...
I20260810 04:51:09.758406 26837 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: tablet copy: Starting download of 1 WAL segments...
I20260810 04:51:09.759588 26837 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 04:51:09.760749 26140 tablet_copy_service.cc:342] P 3c2d0e217274446399735c268b7ea38d: Request end of tablet copy session 50405d6f5abb4adea5dd522681e9cd54-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.239.253@KRBTEST.COM'} at 127.0.0.1:56050
I20260810 04:51:09.760828 26140 tablet_copy_service.cc:433] P 3c2d0e217274446399735c268b7ea38d: ending tablet copy session 50405d6f5abb4adea5dd522681e9cd54-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 50405d6f5abb4adea5dd522681e9cd54
I20260810 04:51:09.764691 26837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:09.766116 27006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.766129 27005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:09.766436 27011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:09.768203 26837 server_base.cc:1034] running on GCE node
I20260810 04:51:09.768350 26837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:09.768574 26837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:09.769721 26837 hybrid_clock.cc:648] HybridClock initialized: now 1786337469769706 us; error 48 us; skew 500 ppm
Aug 10 04:51:09 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337469, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:09.771399 26837 init.cc:377] Logged in from keytab as oryx/127.15.239.253@KRBTEST.COM (short username oryx)
I20260810 04:51:09.771811 26837 webserver.cc:460] Webserver started at http://127.15.239.253:32971/ using document root <none> and password file <none>
I20260810 04:51:09.771984 26837 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:09.772073 26837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:09.772900 26837 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:09.773602 27024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:09.773746 26837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 04:51:09.773800 26837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
uuid: "50405d6f5abb4adea5dd522681e9cd54"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "856d4570bc6c9229bb5005f2f0cf3a4d"
server_key_iv: "a230bdef1df4e71e08f47d56b816d7a4"
server_key_version: "encryptionkey@0"
I20260810 04:51:09.773885 26837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:09.789637 26837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:09.791491 26837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:09.795903 27102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.253:34601 every 8 connection(s)
I20260810 04:51:09.795877 26837 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.253:34601
I20260810 04:51:09.796430 26837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
I20260810 04:51:09.797681 27103 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:51:09.798344 27103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Bootstrap starting.
I20260810 04:51:09.801997 27103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:51:09.802246 27103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: Bootstrap complete.
I20260810 04:51:09.802490 27103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } }
I20260810 04:51:09.802603 27103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 50405d6f5abb4adea5dd522681e9cd54, State: Initialized, Role: LEARNER
I20260810 04:51:09.802647 27103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } }
I20260810 04:51:09.802861 27103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:09.802860 27106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } }
I20260810 04:51:09.802999 27106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:51:09.804751 27123 catalog_manager.cc:1259] Loaded cluster ID: 4ca2dc32422b46eca18819d9e8ca34eb
I20260810 04:51:09.804852 27123 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: loading cluster ID for follower catalog manager: success
I20260810 04:51:09.806107 27123 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: acquiring CA information for follower catalog manager: success
I20260810 04:51:09.806453 27123 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 04:51:09.818094 26156 messenger.cc:188] Invalid argument: socket address is ambiguous: no data on pending connections for acceptor pool at 127.15.239.254:42783
I20260810 04:51:09.839561 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:09.831056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55220 (local address 127.15.239.253:34601)
0810 04:51:09.831236 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:09.831238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:09.831248 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:09.831281 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:09.831282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:09.831294 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:09.831379 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:09.832290 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.833093 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.834256 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:09.834498 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:09.834560 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:09.836326 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:09.836328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:09.836328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:09.836341 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:09.838083 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.838560 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.838561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.838562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.838638 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:09.838880 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:09.838881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:09.838882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:09.839018 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:09.839140 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:09.839271 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 04:51:09.839378 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":117,"threads_started":1}
WARNING: no policy specified for oryx/127.15.239.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.252.keytab.
Entry for principal oryx/127.15.239.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.252.keytab.
I20260810 04:51:09.876576 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:44309
--webserver_interface=127.15.239.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.252.keytab
--principal=oryx/127.15.239.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:09.991752 27129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:09.992161 27129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:09.992218 27129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:09.993891 27129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:09.993971 27129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:09.993997 27129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:09.994022 27129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:09.994051 27129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:09.996183 27129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.252.keytab
--principal=oryx/127.15.239.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:44309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.239.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:09.996578 27129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:09.996894 27129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:10.003253 27135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.003309 27136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.003257 27138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.004151 27129 server_base.cc:1034] running on GCE node
I20260810 04:51:10.004506 27129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:10.004976 27129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:10.006145 27129 hybrid_clock.cc:648] HybridClock initialized: now 1786337470006134 us; error 37 us; skew 500 ppm
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:10.009642 27129 init.cc:377] Logged in from keytab as oryx/127.15.239.252@KRBTEST.COM (short username oryx)
I20260810 04:51:10.010311 27129 webserver.cc:460] Webserver started at http://127.15.239.252:41535/ using document root <none> and password file <none>
I20260810 04:51:10.010603 27129 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:10.010679 27129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:10.010849 27129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:10.012274 27129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/instance:
uuid: "37e0f8a7242648b8b5caa484cfd55e07"
format_stamp: "Formatted at 2026-08-10 04:51:10 on dist-test-slave-kvfs"
server_key: "89e643294f397674dbe85d4f95c7bd79"
server_key_iv: "d87722111a41063921807d3d7c7f840c"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.012724 27129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal/instance:
uuid: "37e0f8a7242648b8b5caa484cfd55e07"
format_stamp: "Formatted at 2026-08-10 04:51:10 on dist-test-slave-kvfs"
server_key: "89e643294f397674dbe85d4f95c7bd79"
server_key_iv: "d87722111a41063921807d3d7c7f840c"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.014329 27129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:10.015275 27150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.015543 27129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:10.015686 27129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
uuid: "37e0f8a7242648b8b5caa484cfd55e07"
format_stamp: "Formatted at 2026-08-10 04:51:10 on dist-test-slave-kvfs"
server_key: "89e643294f397674dbe85d4f95c7bd79"
server_key_iv: "d87722111a41063921807d3d7c7f840c"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.015825 27129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:10.029937 27129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:10.032997 27129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:10.033174 27129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:10.038635 27129 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.252:44309
I20260810 04:51:10.038710 27236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.252:44309 every 8 connection(s)
I20260810 04:51:10.039131 27129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
I20260810 04:51:10.040397 27237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:10.042559 27237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } has no permanent_uuid. Determining permanent_uuid...
W20260810 04:51:10.043483 26162 acceptor_pool.cc:285] unable to collect diagnostics on RPC socket 127.15.239.254:42783: Invalid argument: socket address is ambiguous
I20260810 04:51:10.045167 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 27129
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.252@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.239.252@KRBTEST.COM
I20260810 04:51:10.054316 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.043647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56064 (local address 127.15.239.254:42783)
0810 04:51:10.043722 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.043725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.043883 (+ 158us) server_negotiation.cc:407] Connection header received
0810 04:51:10.044494 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.044495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.044509 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.044570 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.045513 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.046247 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.047604 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.047931 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.048003 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.050749 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.050751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.050751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.050760 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.052592 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.053064 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.053066 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.053067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.053145 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.053506 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.053508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.053508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.053655 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.053746 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.054094 (+ 348us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.054193 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:51:10.054539 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.043417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:56064)
0810 04:51:10.043733 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.043778 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.044381 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.044652 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.044656 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.045032 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.045409 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.045416 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.046345 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.046346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.047506 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.047509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.048061 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.048063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.048211 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.048843 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.048856 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.050615 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.052683 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.052690 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.052693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.052974 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.053234 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.053235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.053235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.053421 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.053734 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.053741 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.053921 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.054047 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.054234 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":140,"threads_started":1}
I20260810 04:51:10.055281 27237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:51:10.058154 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.045788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45168 (local address 127.15.239.252:44309)
0810 04:51:10.046035 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.046039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.046056 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:51:10.046075 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.046077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.046096 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.046186 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.047002 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.047902 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.048925 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.049344 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.049417 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.052319 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.052327 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.052327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.052334 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.055647 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.057158 (+ 1511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.057162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.057163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.057240 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.057527 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.057528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.057528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.057736 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.057903 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.057977 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.058069 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":171,"threads_started":1}
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.252@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
I20260810 04:51:10.063243 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.055647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:55228)
0810 04:51:10.055710 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.055723 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.055762 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.056166 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.056167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.056319 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.056358 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.056360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.057122 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.057123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.057892 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.057895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.058435 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.058436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.058507 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.059005 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.059010 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.060315 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.062111 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.062112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.062113 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.062299 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.062587 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.062588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.062588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.062657 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.062971 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.062972 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.063014 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.063071 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.063165 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 04:51:10.063282 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.055740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55228 (local address 127.15.239.253:34601)
0810 04:51:10.055919 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.055921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.055930 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:51:10.055955 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.055956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.055967 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.056166 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.056476 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.057031 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.057992 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.058343 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.058421 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.060404 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.060405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.060405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.060416 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.062016 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.062414 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.062415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.062415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.062484 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.062734 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.062734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.062735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.062894 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.062954 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.063110 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.063206 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:51:10.063862 27237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.252@KRBTEST.COM for oryx/127.15.239.252@KRBTEST.COM
I20260810 04:51:10.070392 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.064246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:45172)
0810 04:51:10.064347 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.064357 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.064390 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.064489 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.064490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.064606 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.064641 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.064642 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.065274 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.065275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.065756 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.065757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.066154 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.066154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.066192 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.066563 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.066568 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.067785 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.069339 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.069340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.069340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.069546 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.069735 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.069736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.069736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.069802 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.070079 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.070079 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.070121 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.070190 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.070281 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 04:51:10.070402 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.064301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.15.239.252:44309)
0810 04:51:10.064370 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.064372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.064384 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:10.064429 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.064430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.064440 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.064488 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.064699 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.065198 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.065833 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.066085 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.066147 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.067864 (+ 1717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.067866 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.067866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.067873 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.069255 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.069617 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.069618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.069618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.069670 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.069861 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.069862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.069862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.069993 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.070049 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.070221 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.070329 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":42}
I20260810 04:51:10.070725 26401 heartbeater.cc:503] Master 127.15.239.254:42783 was elected leader, sending a full tablet report...
I20260810 04:51:10.072633 27237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Bootstrap starting.
I20260810 04:51:10.073662 27237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:10.074082 27237 log.cc:824] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:10.075161 27237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: No bootstrap required, opened a new log
I20260810 04:51:10.077080 27237 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } }
I20260810 04:51:10.077250 27237 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:10.077276 27237 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e0f8a7242648b8b5caa484cfd55e07, State: Initialized, Role: FOLLOWER
I20260810 04:51:10.077435 27237 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } }
I20260810 04:51:10.077841 27237 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:10.077793 27243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } } }
I20260810 04:51:10.077929 27243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:51:10.080060 27260 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:51:10.080144 27260 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:51:10.083389 27129 master_runner.cc:428] Detected that this master 37e0f8a7242648b8b5caa484cfd55e07 is joining an existing cluster
I20260810 04:51:10.083472 27129 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.239.252:44309
I20260810 04:51:10.109081 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.085209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56078 (local address 127.15.239.254:42783)
0810 04:51:10.085267 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.085270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.092319 (+ 7049us) server_negotiation.cc:407] Connection header received
0810 04:51:10.092368 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.092371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.092391 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.092477 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.092887 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.093855 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.094651 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.095016 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.095099 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.105298 (+ 10199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.105301 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.105301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.105314 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.107377 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108025 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.108027 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.108028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.108119 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108349 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.108351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.108351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.108545 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.108594 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.108831 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.108934 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:51:10.109673 27270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.085033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:56078)
0810 04:51:10.092203 (+ 7170us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.092218 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.092297 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.092500 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.092500 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.092726 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.092800 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.092801 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.093947 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.093948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.094563 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.094565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.095135 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.095136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.095191 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.095748 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.095753 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.105141 (+ 9388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.107524 (+ 2383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.107526 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.107526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.107922 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.108202 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.108203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.108273 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.108644 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.108645 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.108703 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.109384 (+ 681us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.109534 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7143,"thread_start_us":70,"threads_started":1}
I20260810 04:51:10.109680 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.085179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.15.239.252:44309)
0810 04:51:10.085255 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.085257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.085616 (+ 359us) server_negotiation.cc:407] Connection header received
0810 04:51:10.085707 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.085708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.085718 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.085747 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.086204 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.086911 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.087697 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.087904 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.087990 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.105280 (+ 17290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.105283 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.105283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.105294 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.108230 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108574 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.108575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.108576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.108626 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108834 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.108835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.108835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.108967 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.109011 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.109180 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.109594 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":46}
I20260810 04:51:10.109889 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 26200
I20260810 04:51:10.110713 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.084972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:45178)
0810 04:51:10.085558 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.085568 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.085639 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.085808 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.085809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.086040 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.086118 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.086121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.086994 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.086999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.087610 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.087611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.087992 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.087992 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.088083 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.088724 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.088729 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.105123 (+ 16394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.108307 (+ 3184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108307 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.108308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.108498 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.108690 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108690 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.108691 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.108770 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.109050 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.109051 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.109080 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.109470 (+ 390us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.110590 (+ 1120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":176,"thread_start_us":106,"threads_started":1}
I20260810 04:51:10.132558 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.085265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.15.239.253:34601)
0810 04:51:10.085312 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.085314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.085435 (+ 121us) server_negotiation.cc:407] Connection header received
0810 04:51:10.085507 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.085507 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.085519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.085597 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.086013 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.086869 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.088187 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.088478 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.088560 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.105319 (+ 16759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.105322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.105322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.105334 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.107522 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108370 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.108371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.108372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.108449 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108687 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.108688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.108689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.108847 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.108908 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.109119 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.132374 (+ 23255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:51:10.133499 27269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.084950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:55230)
0810 04:51:10.085349 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.085362 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.085442 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.085604 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.085606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.085835 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.085928 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.085930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.086973 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.086974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.088092 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.088096 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.088577 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.088578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.088657 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.089007 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.089013 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.105135 (+ 16122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.107635 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.107636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.107637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.108081 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.108541 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.108542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.108542 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.108609 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.108943 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.108944 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.108993 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.133062 (+ 24069us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.133296 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":112,"threads_started":1}
I20260810 04:51:10.143388 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:32965
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:42783
--webserver_port=36453
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337468, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.254@KRBTEST.COM for oryx/127.15.239.252@KRBTEST.COM
I20260810 04:51:10.149784 26981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.141054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:45180)
0810 04:51:10.141117 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.141133 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.141200 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.141397 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.141398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.141664 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.141749 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.141752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.142772 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.142773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.143728 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.143732 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.144274 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.144276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.144376 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.144968 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.144976 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.146680 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.148596 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.148598 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.148599 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.148807 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.149065 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.149066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.149067 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.149138 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.149465 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.149467 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.149526 (+ 59us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.149576 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.149693 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:51:10.150279 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.141157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45180 (local address 127.15.239.252:44309)
0810 04:51:10.141234 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.141236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.141247 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:10.141297 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.141298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.141311 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.141377 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.141841 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.142658 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.143837 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.144193 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.144264 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.146788 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.146789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.146789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.146799 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.148466 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.148886 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.148888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.148889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.148997 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.149203 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.149204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.149205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.149347 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.150039 (+ 692us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.150088 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.150175 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:51:10.150925 26105 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.239.252:44309: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07"
member_type: NON_VOTER
last_known_addr {
host: "127.15.239.252"
port: 44309
}
attrs {
promote: true
}
}
dest_uuid: "3c2d0e217274446399735c268b7ea38d"
cas_config_opid_index: 5
I20260810 04:51:10.151301 26105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } }
I20260810 04:51:10.151846 26982 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.153185 26982 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.239.252:44309
I20260810 04:51:10.153270 26982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.153354 26982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.154500 27195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:10.156412 27195 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Refusing update from remote peer 3c2d0e217274446399735c268b7ea38d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 04:51:10.156641 27129 master.cc:537] Master@127.15.239.252:44309 shutting down...
I20260810 04:51:10.156983 26984 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 04:51:10.157976 26081 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d -> Peer 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252:44309): Couldn't send request to peer 37e0f8a7242648b8b5caa484cfd55e07. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 04:51:10.159986 27129 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:10.160283 27129 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:10.160346 27129 tablet_replica.cc:330] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: stopping tablet replica
I20260810 04:51:10.161479 26981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.153633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:55242)
0810 04:51:10.156910 (+ 3277us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.156925 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.156995 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.157282 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.157283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.157285 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.157351 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.157353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.158381 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.158382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.159625 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.159629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.161144 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.161145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.161226 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.161266 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.161316 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.161381 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3256}
I20260810 04:51:10.161777 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.153779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55242 (local address 127.15.239.253:34601)
0810 04:51:10.156866 (+ 3087us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.156870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.157057 (+ 187us) server_negotiation.cc:407] Connection header received
0810 04:51:10.157097 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.157098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.157135 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.157201 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.157434 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.158272 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.160120 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.160897 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.160966 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.161074 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.161633 (+ 559us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.161693 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3037}
I20260810 04:51:10.162057 27056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 LEARNER]: Refusing update from remote peer 3c2d0e217274446399735c268b7ea38d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 04:51:10.162432 26984 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 04:51:10.163272 27056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.164705 27106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c2d0e217274446399735c268b7ea38d. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.164799 27106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:51:10.164839 27106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: NON_VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: true } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.164884 27106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:51:10.164917 26984 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: attempting to promote NON_VOTER 50405d6f5abb4adea5dd522681e9cd54 to VOTER
I20260810 04:51:10.165189 26984 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } }
I20260810 04:51:10.165761 26981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.165603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:45184)
0810 04:51:10.165664 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.165721 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:44309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 04:51:10.165881 27056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 LEARNER]: Refusing update from remote peer 3c2d0e217274446399735c268b7ea38d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 04:51:10.166254 26981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.166001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:45190)
0810 04:51:10.166173 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.166205 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:44309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260810 04:51:10.166196 26983 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260810 04:51:10.166363 26081 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d -> Peer 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252:44309): Couldn't send request to peer 37e0f8a7242648b8b5caa484cfd55e07. Status: Network error: Client connection negotiation failed: client connection to 127.15.239.252:44309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 04:51:10.166924 26985 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.168265 26985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.168355 26985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.168437 26982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.168527 26982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.168663 27056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.169662 27274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.169757 27274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:51:10.175074 27129 master.cc:552] Master@127.15.239.252:44309 shutdown complete.
I20260810 04:51:10.175173 27129 master_runner.cc:305] Clearing existing system tablet
I20260810 04:51:10.175321 27129 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:10.175361 27129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:10.176218 27129 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:10.177003 27278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.177414 27129 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:10.177523 27129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:10.177559 27129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
uuid: "37e0f8a7242648b8b5caa484cfd55e07"
format_stamp: "Formatted at 2026-08-10 04:51:10 on dist-test-slave-kvfs"
server_key: "89e643294f397674dbe85d4f95c7bd79"
server_key_iv: "d87722111a41063921807d3d7c7f840c"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.178596 27129 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:10.180322 27129 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 04:51:10.180435 27129 log.cc:1196] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 04:51:10.180691 27129 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Deleting consensus metadata
I20260810 04:51:10.180861 27129 master_runner.cc:315] Copying system tablet from 127.15.239.254:42783
I20260810 04:51:10.181671 27129 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: tablet copy: Beginning tablet copy session from remote peer at address 127.15.239.254:42783
I20260810 04:51:10.189242 27286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.182091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:56090)
0810 04:51:10.182279 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.182299 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.182404 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.182553 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.182554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.182780 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.182862 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.182865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.183761 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.183763 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.184548 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.184551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.184972 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.184973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.185033 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.185653 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.185660 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.186041 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.187955 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.187957 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.187957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.188234 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.188480 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.188481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.188481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.188556 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.188842 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.188843 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.188897 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.188988 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.189125 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":97,"threads_started":1}
I20260810 04:51:10.189242 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.182155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56090 (local address 127.15.239.254:42783)
0810 04:51:10.182223 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.182226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.182383 (+ 157us) server_negotiation.cc:407] Connection header received
0810 04:51:10.182472 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.182473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.182488 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.182539 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.182966 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.183652 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.184649 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.184881 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.184971 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.186164 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.186166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.186166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.186175 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.187825 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.188324 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.188326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.188327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.188401 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.188627 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.188628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.188628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.188771 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.188860 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.189024 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.189125 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:51:10.189983 26140 tablet_copy_service.cc:140] P 3c2d0e217274446399735c268b7ea38d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 37e0f8a7242648b8b5caa484cfd55e07 ({username='oryx', principal='oryx/127.15.239.252@KRBTEST.COM'} at 127.0.0.1:56090)
I20260810 04:51:10.190083 26140 tablet_copy_service.cc:161] P 3c2d0e217274446399735c268b7ea38d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 37e0f8a7242648b8b5caa484cfd55e07 at {username='oryx', principal='oryx/127.15.239.252@KRBTEST.COM'} at 127.0.0.1:56090: session id = 37e0f8a7242648b8b5caa484cfd55e07-00000000000000000000000000000000
I20260810 04:51:10.190809 26140 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 04:51:10.191421 27129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 04:51:10.192768 27129 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: tablet copy: Starting download of 0 data blocks...
I20260810 04:51:10.192986 27129 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: tablet copy: Starting download of 1 WAL segments...
I20260810 04:51:10.193871 27129 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 04:51:10.194790 26140 tablet_copy_service.cc:342] P 3c2d0e217274446399735c268b7ea38d: Request end of tablet copy session 37e0f8a7242648b8b5caa484cfd55e07-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.239.252@KRBTEST.COM'} at 127.0.0.1:56090
I20260810 04:51:10.194888 26140 tablet_copy_service.cc:433] P 3c2d0e217274446399735c268b7ea38d: ending tablet copy session 37e0f8a7242648b8b5caa484cfd55e07-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 37e0f8a7242648b8b5caa484cfd55e07
I20260810 04:51:10.197739 27129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:10.199103 27288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.199416 27290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.199610 27129 server_base.cc:1034] running on GCE node
W20260810 04:51:10.199887 27295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.200088 27129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:10.200294 27129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:10.201432 27129 hybrid_clock.cc:648] HybridClock initialized: now 1786337470201418 us; error 39 us; skew 500 ppm
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:10.203214 27129 init.cc:377] Logged in from keytab as oryx/127.15.239.252@KRBTEST.COM (short username oryx)
I20260810 04:51:10.203560 27129 webserver.cc:460] Webserver started at http://127.15.239.252:41727/ using document root <none> and password file <none>
I20260810 04:51:10.203692 27129 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:10.203733 27129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:10.204639 27129 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:10.205237 27304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.205394 27129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:51:10.205469 27129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
uuid: "37e0f8a7242648b8b5caa484cfd55e07"
format_stamp: "Formatted at 2026-08-10 04:51:10 on dist-test-slave-kvfs"
server_key: "89e643294f397674dbe85d4f95c7bd79"
server_key_iv: "d87722111a41063921807d3d7c7f840c"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.205569 27129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:10.216395 27129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:10.218474 27129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:10.222443 27129 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.252:44309
I20260810 04:51:10.222944 27129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
I20260810 04:51:10.223297 27380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.252:44309 every 8 connection(s)
I20260810 04:51:10.224388 27384 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:51:10.224939 27384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Bootstrap starting.
I20260810 04:51:10.228313 27384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:51:10.228619 27384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Bootstrap complete.
I20260810 04:51:10.228909 27384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } }
I20260810 04:51:10.229024 27384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 37e0f8a7242648b8b5caa484cfd55e07, State: Initialized, Role: LEARNER
I20260810 04:51:10.229075 27384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } }
I20260810 04:51:10.229277 27389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.229391 27384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:10.229441 27389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:51:10.232077 27401 catalog_manager.cc:1259] Loaded cluster ID: 4ca2dc32422b46eca18819d9e8ca34eb
I20260810 04:51:10.232136 27401 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: loading cluster ID for follower catalog manager: success
I20260810 04:51:10.232995 27401 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: acquiring CA information for follower catalog manager: success
I20260810 04:51:10.233325 27401 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:51:10.263549 26619 heartbeater.cc:503] Master 127.15.239.254:42783 was elected leader, sending a full tablet report...
W20260810 04:51:10.291795 27271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:10.292269 27271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:10.292328 27271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:10.294458 27271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:10.294541 27271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:10.294593 27271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:10.297245 27271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:32965
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=36453
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:10.297590 27271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:10.297910 27271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:10.304471 27407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.304715 27271 server_base.cc:1034] running on GCE node
W20260810 04:51:10.304543 27406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.304849 27409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.305075 27271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:10.305482 27271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:10.306700 27271 hybrid_clock.cc:648] HybridClock initialized: now 1786337470306679 us; error 47 us; skew 500 ppm
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:10.309892 27271 init.cc:377] Logged in from keytab as oryx/127.15.239.193@KRBTEST.COM (short username oryx)
I20260810 04:51:10.310395 27271 webserver.cc:460] Webserver started at http://127.15.239.193:36453/ using document root <none> and password file <none>
I20260810 04:51:10.310686 27271 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:10.310761 27271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:10.312688 27271 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:10.313401 27424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.313628 27271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:10.313763 27271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "34954b6eebeb4687862b4fb18190333e"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "5b7e401be046f863fc433299116bfcd3"
server_key_iv: "00bd33211b9695e01382f8f807256de2"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.314234 27271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:10.347797 27271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:10.350831 27271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:10.351042 27271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:10.351393 27271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:10.351809 27271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:10.351867 27271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.351907 27271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:10.351956 27271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.359552 27271 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:32965
I20260810 04:51:10.359612 27592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:32965 every 8 connection(s)
I20260810 04:51:10.360172 27271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:10.363965 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 27271
I20260810 04:51:10.364207 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 26408
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.252@KRBTEST.COM
I20260810 04:51:10.382407 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.361484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:50337 (local address 127.15.239.253:34601)
0810 04:51:10.361548 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.361550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.361918 (+ 368us) server_negotiation.cc:407] Connection header received
0810 04:51:10.363237 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.363239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.363259 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.363324 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.370255 (+ 6931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.371074 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.372247 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.372557 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.372600 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.378448 (+ 5848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.378452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.378452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.378465 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.380520 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.381140 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.381141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.381142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.381209 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.381587 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.381588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.381588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.381744 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.381810 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.382172 (+ 362us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.382289 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:51:10.382473 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.361392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:34861 (local address 127.15.239.254:42783)
0810 04:51:10.361463 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.361466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.361756 (+ 290us) server_negotiation.cc:407] Connection header received
0810 04:51:10.363278 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.363281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.363298 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.363335 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.364627 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.365518 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.367184 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.367409 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.367446 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.378450 (+ 11004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.378453 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.378454 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.378466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.380507 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.381128 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.381130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.381130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.381207 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.381538 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.381540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.381540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.381731 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.381810 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.382196 (+ 386us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.382310 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:51:10.382999 27608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.361156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.15.239.193:50337)
0810 04:51:10.361761 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.361837 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.363087 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.363426 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.363430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.364092 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.370129 (+ 6037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.370131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.371188 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.371188 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.372134 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.372136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.372702 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.372702 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.372771 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.374727 (+ 1956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.374732 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.378272 (+ 3540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.380623 (+ 2351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.380633 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.380637 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.381044 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.381291 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.381291 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.381292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.381471 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.381841 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.381842 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.382014 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.382137 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.382358 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":103,"thread_start_us":193,"threads_started":1}
I20260810 04:51:10.383005 27606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.361156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:34861)
0810 04:51:10.361648 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.361661 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.363108 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.363442 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.363443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.364093 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.364492 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.364500 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.365668 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.365669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.367087 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.367089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.367564 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.367565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.367695 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.374618 (+ 6923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.374634 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.378272 (+ 3638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.380620 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.380633 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.380637 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.381039 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.381288 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.381288 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.381289 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.381450 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.381816 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.381825 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.382015 (+ 190us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.382588 (+ 573us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.382726 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":30,"thread_start_us":420,"threads_started":1}
I20260810 04:51:10.383754 27595 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42783
I20260810 04:51:10.383898 27595 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.384193 27595 heartbeater.cc:511] Master 127.15.239.254:42783 requested a full tablet report, sending...
I20260810 04:51:10.384334 27598 heartbeater.cc:347] Connected to a master server at 127.15.239.253:34601
I20260810 04:51:10.384402 27598 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.384497 27598 heartbeater.cc:511] Master 127.15.239.253:34601 requested a full tablet report, sending...
I20260810 04:51:10.384778 26105 ts_manager.cc:194] Re-registered known tserver with Master: 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965)
I20260810 04:51:10.385017 27045 ts_manager.cc:194] Registered new tserver with Master: 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965)
I20260810 04:51:10.385411 26105 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:34861
I20260810 04:51:10.386389 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:37471
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:42783
--webserver_port=38811
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:51:10.388164 27605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.361368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:34941 (local address 127.15.239.252:44309)
0810 04:51:10.361546 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.361549 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.361863 (+ 314us) server_negotiation.cc:407] Connection header received
0810 04:51:10.363427 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.363429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.363446 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.363530 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.370255 (+ 6725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.371320 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.372337 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.372656 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.372698 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.384710 (+ 12012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.384713 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.384714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.384731 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.386761 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.387170 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.387172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.387173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.387245 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.387485 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.387498 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.387499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.387647 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.387731 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.387904 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.388054 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260810 04:51:10.388176 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.361156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.15.239.193:34941)
0810 04:51:10.361598 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.361659 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.363087 (+ 1428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.363542 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.363543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.364092 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.370111 (+ 6019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.370115 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.371421 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.371422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.372242 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.372244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.372782 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.372783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.372863 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.374663 (+ 1800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.374670 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.379466 (+ 4796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.386860 (+ 7394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.386861 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.386861 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.387074 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.387327 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.387328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.387329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.387401 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.387721 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.387722 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.387771 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.387861 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.388043 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":3,"thread_start_us":492,"threads_started":1}
I20260810 04:51:10.388693 27594 heartbeater.cc:347] Connected to a master server at 127.15.239.252:44309
I20260810 04:51:10.388764 27594 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.388891 27594 heartbeater.cc:511] Master 127.15.239.252:44309 requested a full tablet report, sending...
I20260810 04:51:10.389382 27335 ts_manager.cc:194] Registered new tserver with Master: 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965)
I20260810 04:51:10.446939 26831 heartbeater.cc:503] Master 127.15.239.254:42783 was elected leader, sending a full tablet report...
W20260810 04:51:10.491860 27609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:10.492206 27609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:10.492249 27609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:10.493558 27609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:10.493643 27609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:10.493690 27609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:10.495409 27609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:37471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=38811
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:10.495755 27609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:10.496100 27609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:10.502394 27621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.502394 27620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.502471 27609 server_base.cc:1034] running on GCE node
W20260810 04:51:10.502388 27625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.502856 27609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:10.503207 27609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:10.504392 27609 hybrid_clock.cc:648] HybridClock initialized: now 1786337470504373 us; error 37 us; skew 500 ppm
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:10.507748 27609 init.cc:377] Logged in from keytab as oryx/127.15.239.194@KRBTEST.COM (short username oryx)
I20260810 04:51:10.508430 27609 webserver.cc:460] Webserver started at http://127.15.239.194:38811/ using document root <none> and password file <none>
I20260810 04:51:10.508836 27609 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:10.508955 27609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:10.510738 27609 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:10.511602 27636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.511811 27609 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:10.511909 27609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "bc902a77ff01450887bfe1a32d856db8"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "cc77af10ca330c36abb383ce232caf65"
server_key_iv: "25d21208ee4aaf4b621fbc4a6a603739"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.512403 27609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:10.523545 27609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:10.526427 27609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:10.526573 27609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:10.526829 27609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:10.527259 27609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:10.527302 27609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.527331 27609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:10.527345 27609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.536283 27609 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:37471
I20260810 04:51:10.536351 27807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:37471 every 8 connection(s)
I20260810 04:51:10.536813 27609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.252@KRBTEST.COM
I20260810 04:51:10.545352 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 27609
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
I20260810 04:51:10.545571 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 26627
I20260810 04:51:10.551672 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.538144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:36287 (local address 127.15.239.253:34601)
0810 04:51:10.538210 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.538213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.538224 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:10.539087 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.539089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.539103 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.539163 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.540009 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.540941 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542257 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.542604 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542651 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.545953 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.545955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.545956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.545965 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.549518 (+ 3553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.550185 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.550186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.550187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.550256 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.550637 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.550638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.550639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.550853 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.550911 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.551435 (+ 524us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.551549 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:51:10.552438 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.537732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.15.239.194:36287)
0810 04:51:10.537934 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.537991 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.538763 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.539197 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.539199 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.539612 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.539877 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.539883 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.541059 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.541060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.542139 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.542141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.542784 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.542877 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.543575 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.543579 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.545848 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.549640 (+ 3792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.549657 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.549662 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.550087 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.550343 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.550344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.550344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.550542 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.550969 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.550982 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.551236 (+ 254us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.551812 (+ 576us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.552123 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":61,"thread_start_us":109,"threads_started":1}
I20260810 04:51:10.553535 27605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.537844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:37017 (local address 127.15.239.252:44309)
0810 04:51:10.537935 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.537938 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.538325 (+ 387us) server_negotiation.cc:407] Connection header received
0810 04:51:10.538915 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.538917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.538938 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.539004 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.540013 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.540939 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542257 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.542658 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542706 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.550044 (+ 7338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.550047 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.550047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.550060 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.551918 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.552633 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.552635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.552635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.552711 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.552928 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.552929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.552929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.553072 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.553160 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.553323 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.553430 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 04:51:10.553555 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.537732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.15.239.194:37017)
0810 04:51:10.538245 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.538257 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.538764 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.539643 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.539644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.539821 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.539883 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.539884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.541086 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.541087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.542139 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.542141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.542793 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542793 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.542867 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.543474 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.543478 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.549897 (+ 6419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.552184 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.552185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.552186 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.552405 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.552798 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.552799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.552799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.552853 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.553160 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.553161 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.553214 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.553293 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.553430 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":307,"thread_start_us":97,"threads_started":1}
I20260810 04:51:10.554203 27808 heartbeater.cc:347] Connected to a master server at 127.15.239.252:44309
I20260810 04:51:10.554358 27808 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.554615 27808 heartbeater.cc:511] Master 127.15.239.252:44309 requested a full tablet report, sending...
I20260810 04:51:10.555222 27335 ts_manager.cc:194] Registered new tserver with Master: bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471)
I20260810 04:51:10.561689 27810 heartbeater.cc:347] Connected to a master server at 127.15.239.253:34601
I20260810 04:51:10.561793 27810 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.561904 27810 heartbeater.cc:511] Master 127.15.239.253:34601 requested a full tablet report, sending...
I20260810 04:51:10.562440 27045 ts_manager.cc:194] Registered new tserver with Master: bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471)
I20260810 04:51:10.565762 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.538050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:58129 (local address 127.15.239.254:42783)
0810 04:51:10.538134 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.538137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.538239 (+ 102us) server_negotiation.cc:407] Connection header received
0810 04:51:10.538947 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.538949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.538965 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.539001 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.539985 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.540623 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.541893 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.542118 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542211 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.561708 (+ 19497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.561712 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.561712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.561728 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.563779 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.564757 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.564759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.564760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.564864 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.565102 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.565104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.565104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.565259 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.565339 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.565527 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.565640 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:51:10.565788 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.537732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:58129)
0810 04:51:10.538160 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.538173 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.538790 (+ 617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.539146 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.539152 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.539589 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.539877 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.539882 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.540742 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.540743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.541790 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.541793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.542219 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.542221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.542385 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.543071 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.543100 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.545030 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.563938 (+ 18908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.563940 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.563941 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.564656 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.564952 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.564953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.564954 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.565035 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.565349 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.565350 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.565406 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.565492 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.565642 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":31,"thread_start_us":96,"threads_started":1}
I20260810 04:51:10.566506 27809 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42783
I20260810 04:51:10.566565 27809 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.566668 27809 heartbeater.cc:511] Master 127.15.239.254:42783 requested a full tablet report, sending...
I20260810 04:51:10.567050 26105 ts_manager.cc:194] Re-registered known tserver with Master: bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471)
I20260810 04:51:10.567518 26105 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:58129
I20260810 04:51:10.567749 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:38749
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:42783
--webserver_port=42783
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:10.668752 27816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:10.669040 27816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:10.669067 27816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:10.670310 27816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:10.670344 27816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:10.670370 27816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:10.671953 27816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:38749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=42783
--tserver_master_addrs=127.15.239.254:42783,127.15.239.253:34601,127.15.239.252:44309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:10.672271 27816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:10.672504 27816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:10.679117 27828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.679126 27826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:10.679141 27832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:10.679427 27816 server_base.cc:1034] running on GCE node
I20260810 04:51:10.679713 27816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:10.680001 27816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:10.681217 27816 hybrid_clock.cc:648] HybridClock initialized: now 1786337470681195 us; error 43 us; skew 500 ppm
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:10.684252 27816 init.cc:377] Logged in from keytab as oryx/127.15.239.195@KRBTEST.COM (short username oryx)
I20260810 04:51:10.684835 27816 webserver.cc:460] Webserver started at http://127.15.239.195:42783/ using document root <none> and password file <none>
I20260810 04:51:10.685117 27816 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:10.685220 27816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:10.686863 27816 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:10.687765 27844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.688153 27816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:10.688298 27816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb"
format_stamp: "Formatted at 2026-08-10 04:51:09 on dist-test-slave-kvfs"
server_key: "703146d8d6943d8d96888421970f7ee8"
server_key_iv: "7a4cf86972d323276c905622ecb19529"
server_key_version: "encryptionkey@0"
I20260810 04:51:10.688815 27816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:10.699919 27816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:10.702533 27816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:10.702754 27816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:10.703063 27816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:10.703537 27816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:10.703609 27816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.703660 27816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:10.703685 27816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:10.712353 27816 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:38749
I20260810 04:51:10.712419 28048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:38749 every 8 connection(s)
I20260810 04:51:10.712898 27816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:10.715492 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 27816
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.253@KRBTEST.COM
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
Aug 10 04:51:10 dist-test-slave-kvfs krb5kdc[26039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337470, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.252@KRBTEST.COM
I20260810 04:51:10.727602 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.713876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:43755 (local address 127.15.239.253:34601)
0810 04:51:10.713951 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.713954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.714398 (+ 444us) server_negotiation.cc:407] Connection header received
0810 04:51:10.715065 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.715072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.715087 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.715166 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.716552 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.717242 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.718965 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.719190 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.719270 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.723664 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.723665 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.723666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.723675 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.726023 (+ 2348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726415 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.726417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.726417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.726476 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726806 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.726808 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.726808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.726961 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.727003 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.727379 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.727468 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:51:10.728281 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.714263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:39537 (local address 127.15.239.254:42783)
0810 04:51:10.714317 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.714319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.715209 (+ 890us) server_negotiation.cc:407] Connection header received
0810 04:51:10.715343 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.715345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.715364 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.715407 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.716549 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.717473 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.718983 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.719343 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.719386 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.723663 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.723665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.723666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.723675 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.725757 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726323 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.726325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.726325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.726406 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726716 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.726717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.726718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.726870 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.726919 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.728079 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.728165 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 04:51:10.728384 28055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.713842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.15.239.195:43755)
0810 04:51:10.714305 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.714316 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.714910 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.715303 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.715308 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.715951 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.716411 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.716419 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.717400 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.717401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.718861 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.718864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.719283 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.719285 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.719444 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.720254 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.720265 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.723548 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.726110 (+ 2562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726110 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.726111 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.726331 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.726668 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726668 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.726669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.726728 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.727048 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.727048 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.727170 (+ 122us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.727787 (+ 617us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.728012 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":340,"thread_start_us":106,"threads_started":1}
I20260810 04:51:10.728516 27605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.713950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:53961 (local address 127.15.239.252:44309)
0810 04:51:10.714038 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.714041 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.714293 (+ 252us) server_negotiation.cc:407] Connection header received
0810 04:51:10.715065 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.715067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.715085 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.715128 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.716549 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.717496 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.718984 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.719334 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.719385 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.724772 (+ 5387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.724774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.724774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.724783 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.726773 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.727328 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.727330 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.727330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.727398 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.727653 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.727654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.727655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.727819 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.727902 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.728276 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.728393 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:51:10.728904 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.713842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.15.239.195:53961)
0810 04:51:10.714118 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.714179 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.714912 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.715302 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.715307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.716085 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.716410 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.716418 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.717680 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.717680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.718866 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.718869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.719484 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.719485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.719569 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.720944 (+ 1375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.720951 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.724655 (+ 3704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.726888 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.726890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.727194 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.727481 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.727482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.727482 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.727573 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.727935 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.727936 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.727995 (+ 59us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.728159 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.728745 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":19,"thread_start_us":98,"threads_started":1}
I20260810 04:51:10.728968 28051 heartbeater.cc:347] Connected to a master server at 127.15.239.253:34601
I20260810 04:51:10.729089 28051 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.729606 28049 heartbeater.cc:347] Connected to a master server at 127.15.239.252:44309
I20260810 04:51:10.729663 28049 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.729775 28049 heartbeater.cc:511] Master 127.15.239.252:44309 requested a full tablet report, sending...
I20260810 04:51:10.730218 28056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.714181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:39537)
0810 04:51:10.715133 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.715144 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.715241 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.715509 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.715510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.716051 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:10.716410 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.716418 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.717591 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.717592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.718866 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.718869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.719482 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.719483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.719569 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.720460 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:10.720466 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:10.723548 (+ 3082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:10.725857 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.725865 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.725868 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.726231 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.726484 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:10.726485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:10.726486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:10.726634 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:10.726969 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:10.726976 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:10.727170 (+ 194us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.729998 (+ 2828us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.730111 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":62,"thread_start_us":94,"threads_started":1}
I20260810 04:51:10.730316 27335 ts_manager.cc:194] Registered new tserver with Master: 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195:38749)
I20260810 04:51:10.730481 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.717866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:45196)
0810 04:51:10.721064 (+ 3198us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.721076 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.721142 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.721925 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.721927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.721930 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.721999 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.722001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.722965 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.722967 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.724315 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.724318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.730130 (+ 5812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.730132 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.730210 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.730216 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.730251 (+ 35us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.730373 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3165,"thread_start_us":73,"threads_started":1}
I20260810 04:51:10.730620 28050 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42783
I20260810 04:51:10.730666 28050 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:10.730729 28050 heartbeater.cc:511] Master 127.15.239.254:42783 requested a full tablet report, sending...
I20260810 04:51:10.730755 28051 heartbeater.cc:511] Master 127.15.239.253:34601 requested a full tablet report, sending...
I20260810 04:51:10.730944 28067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.718056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45196 (local address 127.15.239.252:44309)
0810 04:51:10.720226 (+ 2170us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.720229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.721702 (+ 1473us) server_negotiation.cc:407] Connection header received
0810 04:51:10.721733 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.721734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.721772 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.722076 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.722121 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.722850 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.725119 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.730008 (+ 4889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.730630 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.730733 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.730757 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.730865 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2145,"thread_start_us":61,"threads_started":1}
I20260810 04:51:10.731112 27045 ts_manager.cc:194] Registered new tserver with Master: 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195:38749)
I20260810 04:51:10.731226 26105 ts_manager.cc:194] Re-registered known tserver with Master: 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195:38749)
I20260810 04:51:10.731200 27347 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 04:51:10.731499 28079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c2d0e217274446399735c268b7ea38d. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.731698 28079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: This master's current role is: LEARNER
I20260810 04:51:10.731694 26105 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:39537
I20260810 04:51:10.735939 28070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.720645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55250 (local address 127.15.239.253:34601)
0810 04:51:10.721572 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.721575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.721583 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:10.721611 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.721612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.721629 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.721728 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.724935 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.725793 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.727021 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.727400 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.727466 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.732302 (+ 4836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.732303 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.732304 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.732312 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.734230 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.734759 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.734760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.734761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.734824 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.735106 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.735107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.735108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.735284 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.735433 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.735558 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.735669 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":899,"thread_start_us":76,"threads_started":1}
I20260810 04:51:10.737596 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.720786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56096 (local address 127.15.239.254:42783)
0810 04:51:10.728374 (+ 7588us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.728376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.728386 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:10.728406 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.728407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.728420 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.728481 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.729982 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.730730 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.732695 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.732994 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.733040 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.734706 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.734708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.734708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.734716 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.736359 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.736696 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.736698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.736698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.736770 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.736972 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.736973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.736973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.737120 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.737241 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.737390 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.737478 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7571,"thread_start_us":78,"threads_started":1}
I20260810 04:51:10.738256 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.720085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45202 (local address 127.15.239.252:44309)
0810 04:51:10.721815 (+ 1730us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.721816 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.721824 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:10.721842 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.721843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.721856 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.722472 (+ 616us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.722868 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.723686 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.724900 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.727607 (+ 2707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.732729 (+ 5122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.734194 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.734195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.734195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.734204 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.736700 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.737087 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.737088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.737089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.737155 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.737364 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.737365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.737366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.737512 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.737639 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.738079 (+ 440us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.738185 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1705,"thread_start_us":64,"threads_started":1}
I20260810 04:51:10.739399 26105 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:10.741600 26105 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:10.742606 26982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: NON_VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: true } } }
I20260810 04:51:10.742723 26982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.744561 28084 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: attempting to promote NON_VOTER 37e0f8a7242648b8b5caa484cfd55e07 to VOTER
I20260810 04:51:10.744896 28084 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:10.745460 27347 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 LEARNER]: Refusing update from remote peer 3c2d0e217274446399735c268b7ea38d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 04:51:10.745486 27056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Refusing update from remote peer 3c2d0e217274446399735c268b7ea38d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 04:51:10.745663 26982 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 04:51:10.745781 28083 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 04:51:10.746521 28083 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.746737 27056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.746933 27347 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.747635 28083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.747730 28083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.747809 28083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.747862 28083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.747921 28083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.747972 28083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:10.748307 28079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.748417 28079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:51:10.749405 28097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c2d0e217274446399735c268b7ea38d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:10.749706 28097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:51:10.754256 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.749654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38749 (local address 127.0.0.1:48480)
0810 04:51:10.750059 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.750071 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.750127 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.750941 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.750941 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.750943 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.750998 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.750999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.751894 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.751895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.753261 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.753263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.753975 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.753976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.754051 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.754055 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.754119 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.754167 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":44,"thread_start_us":98,"threads_started":1}
I20260810 04:51:10.754273 28107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.749942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48480 (local address 127.15.239.195:38749)
0810 04:51:10.750600 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.750605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.750615 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:10.750661 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.750663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.750756 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.750857 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.751085 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.751799 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.753337 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.753884 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.754005 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.754119 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.754149 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.754191 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":112,"threads_started":1}
I20260810 04:51:10.754518 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.749654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:32965 (local address 127.0.0.1:43358)
0810 04:51:10.749707 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.749722 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.749780 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.750448 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.750449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.750452 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.750567 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.750570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.752124 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.752125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.753189 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.753191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.754222 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.754224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.754310 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.754314 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.754364 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.754428 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":1}
I20260810 04:51:10.754640 28099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.749891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:37471 (local address 127.0.0.1:44462)
0810 04:51:10.750380 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.750391 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.750453 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.750735 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.750736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.750739 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.750802 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.750804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.752224 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.752225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.753201 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.753204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.754320 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.754321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.754409 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.754413 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.754475 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.754518 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":8,"thread_start_us":90,"threads_started":1}
I20260810 04:51:10.754678 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.750156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44462 (local address 127.15.239.194:37471)
0810 04:51:10.750357 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.750361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.750458 (+ 97us) server_negotiation.cc:407] Connection header received
0810 04:51:10.750519 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.750522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.750543 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.750643 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.750895 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.752133 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.753301 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.754115 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.754218 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.754282 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.754511 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.754575 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260810 04:51:10.755455 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.749941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43358 (local address 127.15.239.193:32965)
0810 04:51:10.750216 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.750223 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.750239 (+ 16us) server_negotiation.cc:407] Connection header received
0810 04:51:10.750297 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.750299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.750320 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.750440 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.750675 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.752002 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.753274 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.754103 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.755244 (+ 1141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.755300 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.755334 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.755381 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":142,"threads_started":1}
I20260810 04:51:10.755326 27704 tablet_service.cc:1467] Processing CreateTablet for tablet a244742cf82f4dc6955cc57cf796373b (DEFAULT_TABLE table=test-table [id=316ea09cc7944addb01d32c895330ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:10.755319 27934 tablet_service.cc:1467] Processing CreateTablet for tablet a244742cf82f4dc6955cc57cf796373b (DEFAULT_TABLE table=test-table [id=316ea09cc7944addb01d32c895330ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:10.755785 27704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a244742cf82f4dc6955cc57cf796373b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:10.755785 27934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a244742cf82f4dc6955cc57cf796373b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:10.756345 27502 tablet_service.cc:1467] Processing CreateTablet for tablet a244742cf82f4dc6955cc57cf796373b (DEFAULT_TABLE table=test-table [id=316ea09cc7944addb01d32c895330ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:10.756682 27502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a244742cf82f4dc6955cc57cf796373b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:10.759888 28112 tablet_bootstrap.cc:492] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Bootstrap starting.
I20260810 04:51:10.760406 28117 tablet_bootstrap.cc:492] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Bootstrap starting.
I20260810 04:51:10.760782 28112 tablet_bootstrap.cc:654] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:10.761066 28117 tablet_bootstrap.cc:654] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:10.761211 28112 log.cc:824] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:10.761439 28117 log.cc:824] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:10.761830 28116 tablet_bootstrap.cc:492] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Bootstrap starting.
I20260810 04:51:10.762236 28112 tablet_bootstrap.cc:492] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: No bootstrap required, opened a new log
I20260810 04:51:10.762365 28112 ts_tablet_manager.cc:1397] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:51:10.762534 28116 tablet_bootstrap.cc:654] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:10.762879 28116 log.cc:824] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:10.763631 28116 tablet_bootstrap.cc:492] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: No bootstrap required, opened a new log
I20260810 04:51:10.763720 28116 ts_tablet_manager.cc:1397] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:51:10.764613 28117 tablet_bootstrap.cc:492] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: No bootstrap required, opened a new log
I20260810 04:51:10.764734 28117 ts_tablet_manager.cc:1397] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 04:51:10.764595 28112 raft_consensus.cc:348] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.764820 28112 raft_consensus.cc:374] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:10.764873 28112 raft_consensus.cc:729] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34954b6eebeb4687862b4fb18190333e, State: Initialized, Role: FOLLOWER
I20260810 04:51:10.765025 28112 consensus_queue.cc:260] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.765378 27595 heartbeater.cc:503] Master 127.15.239.254:42783 was elected leader, sending a full tablet report...
I20260810 04:51:10.765383 28112 ts_tablet_manager.cc:1428] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:51:10.768061 28117 raft_consensus.cc:348] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.768379 28117 raft_consensus.cc:374] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:10.768334 28116 raft_consensus.cc:348] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.768517 28116 raft_consensus.cc:374] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:10.768468 28117 raft_consensus.cc:729] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, State: Initialized, Role: FOLLOWER
I20260810 04:51:10.768563 28116 raft_consensus.cc:729] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc902a77ff01450887bfe1a32d856db8, State: Initialized, Role: FOLLOWER
I20260810 04:51:10.768674 28116 consensus_queue.cc:260] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.768674 28117 consensus_queue.cc:260] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.769009 28117 ts_tablet_manager.cc:1428] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 04:51:10.769011 28116 ts_tablet_manager.cc:1428] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260810 04:51:10.769126 27809 heartbeater.cc:503] Master 127.15.239.254:42783 was elected leader, sending a full tablet report...
I20260810 04:51:10.769287 28050 heartbeater.cc:503] Master 127.15.239.254:42783 was elected leader, sending a full tablet report...
W20260810 04:51:10.787899 27811 tablet.cc:2369] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:51:10.861908 27602 tablet.cc:2369] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:51:10.866453 28123 raft_consensus.cc:482] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:10.866640 28123 raft_consensus.cc:504] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.867235 28123 leader_election.cc:288] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965), bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471)
I20260810 04:51:10.872108 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.867699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:60443 (local address 127.15.239.194:37471)
0810 04:51:10.867757 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.867760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.867774 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:51:10.867842 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.867843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.867854 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.867914 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.868297 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.869155 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.870952 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.871613 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.871698 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.871710 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.871937 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.872000 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:51:10.872108 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.867711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:48249 (local address 127.15.239.193:32965)
0810 04:51:10.867764 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.867766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.867774 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:10.867816 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.867817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.867828 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.867906 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:10.868294 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.869136 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.870996 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.871606 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.871698 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.871711 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.871939 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.872002 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:51:10.872107 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.867586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:32965 (local address 127.15.239.195:48249)
0810 04:51:10.867647 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.867657 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.867691 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.867963 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.867965 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.867968 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.868152 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.868156 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.869274 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.869275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.870838 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.870842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.871717 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.871719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.871824 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.871829 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.871923 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.871957 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":179}
I20260810 04:51:10.872107 28056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.867537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:37471 (local address 127.15.239.195:60443)
0810 04:51:10.867603 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:10.867617 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:10.867686 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:10.867963 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:10.867965 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:10.867968 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:10.868152 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.868156 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.869274 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.869275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.870838 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:10.870842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.871719 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.871720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:10.871824 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.871829 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:10.871897 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:51:10.871957 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":79}
I20260810 04:51:10.872702 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a244742cf82f4dc6955cc57cf796373b" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc902a77ff01450887bfe1a32d856db8" is_pre_election: true
I20260810 04:51:10.872813 27526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a244742cf82f4dc6955cc57cf796373b" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34954b6eebeb4687862b4fb18190333e" is_pre_election: true
I20260810 04:51:10.872944 27735 raft_consensus.cc:2454] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 0.
I20260810 04:51:10.873083 27526 raft_consensus.cc:2454] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 0.
I20260810 04:51:10.873275 27855 leader_election.cc:302] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, bc902a77ff01450887bfe1a32d856db8; no voters:
I20260810 04:51:10.873497 28123 raft_consensus.cc:2781] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:10.873576 28123 raft_consensus.cc:482] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:10.873596 28123 raft_consensus.cc:3037] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:10.874672 28123 raft_consensus.cc:504] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.874872 28123 leader_election.cc:288] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 election: Requested vote from peers 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965), bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471)
I20260810 04:51:10.875073 27526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a244742cf82f4dc6955cc57cf796373b" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34954b6eebeb4687862b4fb18190333e"
I20260810 04:51:10.875068 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a244742cf82f4dc6955cc57cf796373b" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc902a77ff01450887bfe1a32d856db8"
I20260810 04:51:10.875175 27526 raft_consensus.cc:3037] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:10.875175 27735 raft_consensus.cc:3037] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:10.876562 27526 raft_consensus.cc:2454] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 1.
I20260810 04:51:10.876562 27735 raft_consensus.cc:2454] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 1.
I20260810 04:51:10.876825 27855 leader_election.cc:302] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, bc902a77ff01450887bfe1a32d856db8; no voters:
I20260810 04:51:10.876953 28123 raft_consensus.cc:2781] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:10.877156 28123 raft_consensus.cc:686] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 LEADER]: Becoming Leader. State: Replica: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, State: Running, Role: LEADER
I20260810 04:51:10.877369 28123 consensus_queue.cc:237] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } }
I20260810 04:51:10.878608 26105 catalog_manager.cc:5495] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195). New cstate: current_term: 1 leader_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } health_report { overall_health: UNKNOWN } } }
I20260810 04:51:10.905850 28107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.902841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48484 (local address 127.15.239.195:38749)
0810 04:51:10.902937 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.902939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.902951 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:10.903018 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.903019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.903046 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.903160 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:10.903349 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.903911 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.904809 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.905057 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.905142 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.905363 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:10.905508 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:10.905618 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.905636 (+ 18us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.905664 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 04:51:10.908581 27526 raft_consensus.cc:1261] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Refusing update from remote peer 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:10.908581 27735 raft_consensus.cc:1261] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Refusing update from remote peer 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:10.909065 28125 consensus_queue.cc:1035] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:10.909237 28123 consensus_queue.cc:1035] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:10.915119 28130 mvcc.cc:205] Tried to move back new op lower bound from 7316838280837517312 to 7316838280714706944. Current Snapshot: MvccSnapshot[applied={T|T < 7316838280837517312 or (T in {7316838280837517312})}]
I20260810 04:51:10.916145 26105 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:10.916273 26105 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:10.918227 26105 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c2d0e217274446399735c268b7ea38d: Sending DeleteTablet for 3 replicas of tablet a244742cf82f4dc6955cc57cf796373b
I20260810 04:51:10.918644 27502 tablet_service.cc:1514] Processing DeleteTablet for tablet a244742cf82f4dc6955cc57cf796373b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:10 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:43358
I20260810 04:51:10.918682 27934 tablet_service.cc:1514] Processing DeleteTablet for tablet a244742cf82f4dc6955cc57cf796373b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:10 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:48480
I20260810 04:51:10.918959 28146 tablet_replica.cc:330] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: stopping tablet replica
I20260810 04:51:10.919085 28146 raft_consensus.cc:2229] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:10.919209 28146 raft_consensus.cc:2258] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:10.919615 27704 tablet_service.cc:1514] Processing DeleteTablet for tablet a244742cf82f4dc6955cc57cf796373b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:10 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:44462
I20260810 04:51:10.919802 28146 ts_tablet_manager.cc:1905] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:10.919893 28148 tablet_replica.cc:330] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: stopping tablet replica
I20260810 04:51:10.920014 28148 raft_consensus.cc:2229] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:10.920182 28148 raft_consensus.cc:2258] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:10.920439 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 26057
I20260810 04:51:10.937166 28148 ts_tablet_manager.cc:1905] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:10.938935 28146 ts_tablet_manager.cc:1918] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:10.939071 28146 log.cc:1196] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/a244742cf82f4dc6955cc57cf796373b
I20260810 04:51:10.939314 28148 ts_tablet_manager.cc:1918] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:10.939402 28148 log.cc:1196] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/a244742cf82f4dc6955cc57cf796373b
I20260810 04:51:10.939489 28146 ts_tablet_manager.cc:1939] T a244742cf82f4dc6955cc57cf796373b P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Deleting consensus metadata
I20260810 04:51:10.939715 28148 ts_tablet_manager.cc:1939] T a244742cf82f4dc6955cc57cf796373b P bc902a77ff01450887bfe1a32d856db8: Deleting consensus metadata
I20260810 04:51:10.944679 28142 tablet_replica.cc:330] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: stopping tablet replica
I20260810 04:51:10.944926 28142 raft_consensus.cc:2229] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:10.945124 28142 raft_consensus.cc:2258] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:10.945824 28142 ts_tablet_manager.cc:1905] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:10.947948 28142 ts_tablet_manager.cc:1918] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:10.948108 28142 log.cc:1196] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/a244742cf82f4dc6955cc57cf796373b
I20260810 04:51:10.948443 28142 ts_tablet_manager.cc:1939] T a244742cf82f4dc6955cc57cf796373b P 34954b6eebeb4687862b4fb18190333e: Deleting consensus metadata
W20260810 04:51:10.949007 27639 connection.cc:535] server connection from 127.0.0.1:44462 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:51:10.949491 27845 connection.cc:535] server connection from 127.0.0.1:48480 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:51:10.949806 27426 connection.cc:535] server connection from 127.0.0.1:43358 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:51:10.954635 28066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.944334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45214 (local address 127.15.239.252:44309)
0810 04:51:10.944443 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.944447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.944754 (+ 307us) server_negotiation.cc:407] Connection header received
0810 04:51:10.944893 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.944895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.944920 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.944957 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.946267 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.947151 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.948510 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.948874 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.948929 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.951123 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.951125 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.951126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.951136 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.953146 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.953616 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.953618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.953618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.953687 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.953898 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.953899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.953899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.954070 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.954159 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.954400 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.954512 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:51:10.962590 28067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.953396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45226 (local address 127.15.239.252:44309)
0810 04:51:10.953470 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.953472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.953555 (+ 83us) server_negotiation.cc:407] Connection header received
0810 04:51:10.953673 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.953675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.953689 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.953724 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.954589 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.955402 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.956840 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.957178 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.957255 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.959021 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.959022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.959023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.959031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.961172 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.961642 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.961643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.961644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.961715 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.961954 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.961955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.961956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.962102 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.962246 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.962333 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.962439 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:51:10.962704 28070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:10.953911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55258 (local address 127.15.239.253:34601)
0810 04:51:10.953970 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:10.953973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:10.954366 (+ 393us) server_negotiation.cc:407] Connection header received
0810 04:51:10.954504 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:10.954506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:10.954529 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:10.954566 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:10.955700 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.956574 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.957440 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:10.957794 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:10.957870 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:10.959316 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:10.959317 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:10.959317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:10.959327 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:10.961220 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.961716 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.961717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.961718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.961782 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:10.962018 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:10.962020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:10.962020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:10.962183 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:10.962285 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:10.962481 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 04:51:10.962594 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 04:51:11.914417 28161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:11.914041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:51505)
0810 04:51:11.914192 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:11.914329 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
W20260810 04:51:11.914994 27809 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:42783 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:11.915167 28167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:11.914768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:37539)
0810 04:51:11.914941 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:11.915051 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":73,"threads_started":1}
I20260810 04:51:11.915591 28168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:11.915253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:53549)
0810 04:51:11.915392 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:11.915532 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
W20260810 04:51:11.915776 28050 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:42783 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
W20260810 04:51:11.915810 27595 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:42783 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:12.418527 28170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c2d0e217274446399735c268b7ea38d)
I20260810 04:51:12.418733 28170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:12.418849 28171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c2d0e217274446399735c268b7ea38d)
I20260810 04:51:12.419034 28171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:12.419252 28170 leader_election.cc:288] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783), 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252:44309)
I20260810 04:51:12.419744 28174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.419426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54032)
0810 04:51:12.419664 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.419707 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":86,"threads_started":1}
I20260810 04:51:12.419742 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.419428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54048)
0810 04:51:12.419605 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.419684 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":66,"threads_started":1}
W20260810 04:51:12.419885 27028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
W20260810 04:51:12.419926 27311 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:12.420145 28171 leader_election.cc:288] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783), 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253:34601)
I20260810 04:51:12.420733 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.420613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54054)
0810 04:51:12.420661 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.420692 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:51:12.420845 27028 leader_election.cc:334] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:12.420964 28175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.420710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54064)
0810 04:51:12.420754 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.420869 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 04:51:12.421053 27311 leader_election.cc:334] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:12.423933 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.419677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:34601 (local address 127.0.0.1:33676)
0810 04:51:12.419816 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.419828 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:12.419910 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:12.420405 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:12.420407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:12.420410 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:12.420483 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:12.420484 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.421453 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.421454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:12.422765 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:12.422769 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.423629 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.423631 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:12.423712 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:12.423719 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 04:51:12.423793 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:51:12.423847 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":65,"threads_started":1}
I20260810 04:51:12.423967 28174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.419465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:44309 (local address 127.0.0.1:46906)
0810 04:51:12.419815 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.419828 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:12.419908 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:12.420295 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:12.420297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:12.420301 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:12.420395 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:12.420397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.421453 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.421454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:12.422766 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:12.422769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.423629 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.423631 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:12.423712 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:12.423719 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 04:51:12.423793 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:51:12.423847 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":3,"thread_start_us":59,"threads_started":1}
I20260810 04:51:12.424057 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.419788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.15.239.252:44309)
0810 04:51:12.420103 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:12.420105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:12.420115 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:12.420152 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:12.420153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:12.420166 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:12.420261 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:12.420485 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.421349 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.422883 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.423511 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.423601 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:12.423615 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:12.423844 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 04:51:12.423909 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":55,"threads_started":1}
I20260810 04:51:12.424317 27347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50405d6f5abb4adea5dd522681e9cd54" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "37e0f8a7242648b8b5caa484cfd55e07" is_pre_election: true
I20260810 04:51:12.424479 27347 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50405d6f5abb4adea5dd522681e9cd54 in term 1.
I20260810 04:51:12.424527 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.419727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33676 (local address 127.15.239.253:34601)
0810 04:51:12.420126 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:12.420128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:12.420136 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:12.420157 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:12.420158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:12.420169 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:12.420261 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:12.420580 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.421348 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.422883 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:12.423502 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:12.423601 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:12.423615 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:12.423840 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 04:51:12.423900 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":53,"threads_started":1}
I20260810 04:51:12.424693 27026 leader_election.cc:302] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e0f8a7242648b8b5caa484cfd55e07, 50405d6f5abb4adea5dd522681e9cd54; no voters: 3c2d0e217274446399735c268b7ea38d
I20260810 04:51:12.424748 27056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37e0f8a7242648b8b5caa484cfd55e07" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "50405d6f5abb4adea5dd522681e9cd54" is_pre_election: true
I20260810 04:51:12.424870 27056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e0f8a7242648b8b5caa484cfd55e07 in term 1.
I20260810 04:51:12.424961 28170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 04:51:12.425007 28170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3c2d0e217274446399735c268b7ea38d)
I20260810 04:51:12.425038 28170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:51:12.425055 27308 leader_election.cc:302] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e0f8a7242648b8b5caa484cfd55e07, 50405d6f5abb4adea5dd522681e9cd54; no voters: 3c2d0e217274446399735c268b7ea38d
I20260810 04:51:12.425184 28171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 04:51:12.425227 28171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3c2d0e217274446399735c268b7ea38d)
I20260810 04:51:12.425251 28171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:51:12.426062 28171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:12.426062 28170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:12.426229 28170 leader_election.cc:288] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [CANDIDATE]: Term 2 election: Requested vote from peers 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783), 37e0f8a7242648b8b5caa484cfd55e07 (127.15.239.252:44309)
I20260810 04:51:12.426294 28171 leader_election.cc:288] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 2 election: Requested vote from peers 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783), 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253:34601)
I20260810 04:51:12.426401 27347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50405d6f5abb4adea5dd522681e9cd54" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "37e0f8a7242648b8b5caa484cfd55e07"
I20260810 04:51:12.426467 27056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37e0f8a7242648b8b5caa484cfd55e07" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "50405d6f5abb4adea5dd522681e9cd54"
I20260810 04:51:12.426522 28174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.426373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54082)
0810 04:51:12.426469 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.426499 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260810 04:51:12.426504 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.426324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54074)
0810 04:51:12.426431 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.426466 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 04:51:12.426492 27347 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 50405d6f5abb4adea5dd522681e9cd54 in current term 2: Already voted for candidate 37e0f8a7242648b8b5caa484cfd55e07 in this term.
I20260810 04:51:12.426558 27056 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e0f8a7242648b8b5caa484cfd55e07 in current term 2: Already voted for candidate 50405d6f5abb4adea5dd522681e9cd54 in this term.
I20260810 04:51:12.426857 28174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.426778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54102)
0810 04:51:12.426814 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.426835 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260810 04:51:12.426920 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.426747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54086)
0810 04:51:12.426875 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.426900 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260810 04:51:12.426971 27028 leader_election.cc:334] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:12.427019 27028 leader_election.cc:302] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50405d6f5abb4adea5dd522681e9cd54; no voters: 37e0f8a7242648b8b5caa484cfd55e07, 3c2d0e217274446399735c268b7ea38d
W20260810 04:51:12.427029 27311 leader_election.cc:334] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:12.427083 28170 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 04:51:12.427119 27311 leader_election.cc:302] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e0f8a7242648b8b5caa484cfd55e07; no voters: 3c2d0e217274446399735c268b7ea38d, 50405d6f5abb4adea5dd522681e9cd54
I20260810 04:51:12.427196 28171 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 04:51:12.915748 28184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.915405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:34189)
0810 04:51:12.915597 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.915654 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":122,"threads_started":1}
I20260810 04:51:12.916446 28186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.916160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:56927)
0810 04:51:12.916333 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.916381 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
I20260810 04:51:12.916524 28185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:12.916136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:41637)
0810 04:51:12.916416 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:12.916459 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":75,"threads_started":1}
I20260810 04:51:13.916980 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:13.916558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:47333)
0810 04:51:13.916813 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:13.916874 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":96,"threads_started":1}
I20260810 04:51:13.917176 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:13.916885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:37935)
0810 04:51:13.917076 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:13.917118 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260810 04:51:13.917300 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:13.916979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:51485)
0810 04:51:13.917196 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:13.917238 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":65,"threads_started":1}
I20260810 04:51:14.246673 28193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:14.246867 28193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:14.247172 28193 leader_election.cc:288] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783), 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253:34601)
I20260810 04:51:14.247527 27056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37e0f8a7242648b8b5caa484cfd55e07" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "50405d6f5abb4adea5dd522681e9cd54" is_pre_election: true
I20260810 04:51:14.247637 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.247376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54396)
0810 04:51:14.247534 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.247581 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260810 04:51:14.247668 27056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e0f8a7242648b8b5caa484cfd55e07 in term 2.
I20260810 04:51:14.247861 27308 leader_election.cc:302] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e0f8a7242648b8b5caa484cfd55e07, 50405d6f5abb4adea5dd522681e9cd54; no voters:
I20260810 04:51:14.247992 28193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 04:51:14.248075 28193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:14.248107 28193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 2 FOLLOWER]: Advancing to term 3
I20260810 04:51:14.248308 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.248187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54406)
0810 04:51:14.248236 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.248285 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:51:14.248412 27311 leader_election.cc:334] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:14.249243 28193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:14.249392 28193 leader_election.cc:288] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 3 election: Requested vote from peers 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783), 50405d6f5abb4adea5dd522681e9cd54 (127.15.239.253:34601)
I20260810 04:51:14.249567 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.249473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54420)
0810 04:51:14.249516 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.249546 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 04:51:14.249640 27056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "37e0f8a7242648b8b5caa484cfd55e07" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "50405d6f5abb4adea5dd522681e9cd54"
I20260810 04:51:14.249747 27056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 2 FOLLOWER]: Advancing to term 3
I20260810 04:51:14.249879 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.249806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54432)
0810 04:51:14.249835 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.249865 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260810 04:51:14.249966 27311 leader_election.cc:334] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
I20260810 04:51:14.250622 27056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e0f8a7242648b8b5caa484cfd55e07 in term 3.
I20260810 04:51:14.250793 27308 leader_election.cc:302] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e0f8a7242648b8b5caa484cfd55e07, 50405d6f5abb4adea5dd522681e9cd54; no voters: 3c2d0e217274446399735c268b7ea38d
I20260810 04:51:14.250926 28193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 04:51:14.251049 28193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [term 3 LEADER]: Becoming Leader. State: Replica: 37e0f8a7242648b8b5caa484cfd55e07, State: Running, Role: LEADER
I20260810 04:51:14.251163 28193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } }
I20260810 04:51:14.251622 28197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37e0f8a7242648b8b5caa484cfd55e07. Latest consensus state: current_term: 3 leader_uuid: "37e0f8a7242648b8b5caa484cfd55e07" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:14.251727 28197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:14.251945 28200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:14.252575 28200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:14.252651 28200 catalog_manager.cc:1259] Loaded cluster ID: 4ca2dc32422b46eca18819d9e8ca34eb
I20260810 04:51:14.252701 28200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:14.252995 28200 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:14.253114 28200 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Loaded TSK: 0
I20260810 04:51:14.253283 28200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:51:14.303651 27335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:14.306319 27335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:14.307862 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.307660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54456)
0810 04:51:14.307745 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.307809 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 04:51:14.307938 27056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [term 3 FOLLOWER]: Refusing update from remote peer 37e0f8a7242648b8b5caa484cfd55e07: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260810 04:51:14.308377 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.308243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.0.0.1:54462)
0810 04:51:14.308315 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.308352 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 04:51:14.308329 28197 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260810 04:51:14.308524 27311 consensus_peers.cc:487] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 -> Peer 3c2d0e217274446399735c268b7ea38d (127.15.239.254:42783): Couldn't send request to peer 3c2d0e217274446399735c268b7ea38d. Status: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 04:51:14.309113 28202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37e0f8a7242648b8b5caa484cfd55e07. Latest consensus state: current_term: 3 leader_uuid: "37e0f8a7242648b8b5caa484cfd55e07" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:14.309250 28202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:51:14.310009 28197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "37e0f8a7242648b8b5caa484cfd55e07" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:14.310173 28202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "37e0f8a7242648b8b5caa484cfd55e07" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3c2d0e217274446399735c268b7ea38d" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42783 } } peers { permanent_uuid: "50405d6f5abb4adea5dd522681e9cd54" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 34601 } attrs { promote: false } } peers { permanent_uuid: "37e0f8a7242648b8b5caa484cfd55e07" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 44309 } attrs { promote: false } } }
I20260810 04:51:14.310271 28202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50405d6f5abb4adea5dd522681e9cd54 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:51:14.310354 28203 mvcc.cc:205] Tried to move back new op lower bound from 7316838294762188800 to 7316838294533541888. Current Snapshot: MvccSnapshot[applied={T|T < 7316838294762188800}]
I20260810 04:51:14.310838 28197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:14.316645 28216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.312435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52836 (local address 127.15.239.194:37471)
0810 04:51:14.312802 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:14.312805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:14.312815 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:14.312850 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:14.312851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:14.312864 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:14.313349 (+ 485us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:14.313411 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.314300 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.315451 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.316245 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.316336 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.316350 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:14.316489 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 04:51:14.316549 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":102,"threads_started":1}
I20260810 04:51:14.316646 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.312335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:37471 (local address 127.0.0.1:52836)
0810 04:51:14.312398 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.312412 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:14.312480 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:14.313028 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:14.313030 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:14.313032 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:14.313169 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:14.313173 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.314428 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.314429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:14.315355 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:14.315357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.316330 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.316331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:14.316387 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.316392 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:14.316465 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:51:14.316526 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":29}
I20260810 04:51:14.316857 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.312689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52240 (local address 127.15.239.193:32965)
0810 04:51:14.312847 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:14.312850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:14.312861 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:14.312900 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:14.312901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:14.312914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:14.313139 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:14.313346 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.314074 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.315670 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.316377 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.316500 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.316510 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:14.316697 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 04:51:14.316760 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260810 04:51:14.316972 28215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.312418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:32965 (local address 127.0.0.1:52240)
0810 04:51:14.312609 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.312621 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:14.312686 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:14.313031 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:14.313032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:14.313034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:14.313277 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:14.313278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.314176 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.314178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:14.315568 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:14.315571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.316493 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.316494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:14.316554 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.316557 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:14.316613 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:51:14.316657 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":130,"thread_start_us":124,"threads_started":1}
I20260810 04:51:14.317358 27502 tablet_service.cc:1467] Processing CreateTablet for tablet 76cf589cf12741a8a1007518bada55a1 (DEFAULT_TABLE table=test-table [id=7e79336ee69e4429bb3d483746d32c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:14.317395 27704 tablet_service.cc:1467] Processing CreateTablet for tablet 76cf589cf12741a8a1007518bada55a1 (DEFAULT_TABLE table=test-table [id=7e79336ee69e4429bb3d483746d32c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:14.317554 27502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76cf589cf12741a8a1007518bada55a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:14.317554 27704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76cf589cf12741a8a1007518bada55a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:14.317800 28218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.312469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38749 (local address 127.0.0.1:52368)
0810 04:51:14.312637 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.312649 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:14.312703 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:14.313152 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:14.313153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:14.313155 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:14.313200 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:14.313202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.314392 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.314393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:14.315647 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:14.315650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.317509 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.317511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:14.317588 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.317594 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:51:14.317657 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:51:14.317709 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":127,"threads_started":1}
I20260810 04:51:14.317804 28221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.312743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.15.239.195:38749)
0810 04:51:14.312961 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:14.312963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:14.312973 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:51:14.313009 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:14.313010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:14.313025 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:14.313278 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:14.313337 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.314302 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.316563 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.317390 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.317509 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.317521 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:14.317668 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 04:51:14.317719 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":132,"threads_started":1}
I20260810 04:51:14.318080 27934 tablet_service.cc:1467] Processing CreateTablet for tablet 76cf589cf12741a8a1007518bada55a1 (DEFAULT_TABLE table=test-table [id=7e79336ee69e4429bb3d483746d32c7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:14.318261 27934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76cf589cf12741a8a1007518bada55a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:14.319572 28222 tablet_bootstrap.cc:492] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e: Bootstrap starting.
I20260810 04:51:14.320111 28222 tablet_bootstrap.cc:654] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:14.320093 28224 tablet_bootstrap.cc:492] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Bootstrap starting.
I20260810 04:51:14.320317 28223 tablet_bootstrap.cc:492] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Bootstrap starting.
I20260810 04:51:14.320634 28224 tablet_bootstrap.cc:654] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:14.320777 28223 tablet_bootstrap.cc:654] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:14.320958 28222 tablet_bootstrap.cc:492] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e: No bootstrap required, opened a new log
I20260810 04:51:14.321172 28222 ts_tablet_manager.cc:1397] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:51:14.321556 28223 tablet_bootstrap.cc:492] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: No bootstrap required, opened a new log
I20260810 04:51:14.321587 28224 tablet_bootstrap.cc:492] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: No bootstrap required, opened a new log
I20260810 04:51:14.321625 28223 ts_tablet_manager.cc:1397] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:14.321638 28224 ts_tablet_manager.cc:1397] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:51:14.321717 28222 raft_consensus.cc:348] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.321832 28222 raft_consensus.cc:374] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:14.321790 28223 raft_consensus.cc:348] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.321785 28224 raft_consensus.cc:348] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.321862 28222 raft_consensus.cc:729] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34954b6eebeb4687862b4fb18190333e, State: Initialized, Role: FOLLOWER
I20260810 04:51:14.321873 28223 raft_consensus.cc:374] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:14.321873 28224 raft_consensus.cc:374] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:14.321900 28224 raft_consensus.cc:729] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, State: Initialized, Role: FOLLOWER
I20260810 04:51:14.321900 28223 raft_consensus.cc:729] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc902a77ff01450887bfe1a32d856db8, State: Initialized, Role: FOLLOWER
I20260810 04:51:14.321938 28222 consensus_queue.cc:260] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.321955 28224 consensus_queue.cc:260] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.321977 28223 consensus_queue.cc:260] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.322190 28224 ts_tablet_manager.cc:1428] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:14.322207 28222 ts_tablet_manager.cc:1428] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:14.322211 28223 ts_tablet_manager.cc:1428] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:14.322641 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.322506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:52013)
0810 04:51:14.322561 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.322601 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 04:51:14.322966 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.322762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:36911)
0810 04:51:14.322883 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.322931 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260810 04:51:14.323742 27594 heartbeater.cc:503] Master 127.15.239.252:44309 was elected leader, sending a full tablet report...
I20260810 04:51:14.324046 28049 heartbeater.cc:503] Master 127.15.239.252:44309 was elected leader, sending a full tablet report...
I20260810 04:51:14.324088 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.323913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:39091)
0810 04:51:14.323967 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.324002 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 04:51:14.324563 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.324388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:52633)
0810 04:51:14.324500 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.324530 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 04:51:14.324685 27808 heartbeater.cc:503] Master 127.15.239.252:44309 was elected leader, sending a full tablet report...
I20260810 04:51:14.324827 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.324717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:35227)
0810 04:51:14.324765 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.324792 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 04:51:14.325165 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.324972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:43883)
0810 04:51:14.325092 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.325131 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260810 04:51:14.466687 28053 tablet.cc:2369] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:51:14.477599 28232 raft_consensus.cc:482] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:14.477769 28232 raft_consensus.cc:504] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.478046 28232 leader_election.cc:288] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471), 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965)
I20260810 04:51:14.478471 27526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cf589cf12741a8a1007518bada55a1" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34954b6eebeb4687862b4fb18190333e" is_pre_election: true
I20260810 04:51:14.478487 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cf589cf12741a8a1007518bada55a1" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc902a77ff01450887bfe1a32d856db8" is_pre_election: true
I20260810 04:51:14.478622 27526 raft_consensus.cc:2454] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 0.
I20260810 04:51:14.478617 27735 raft_consensus.cc:2454] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 0.
I20260810 04:51:14.478890 27850 leader_election.cc:302] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34954b6eebeb4687862b4fb18190333e, 6d1f1ece789649f5bfe1c7a8f9a9dbdb; no voters:
I20260810 04:51:14.479048 28232 raft_consensus.cc:2781] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:14.479099 28232 raft_consensus.cc:482] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:14.479115 28232 raft_consensus.cc:3037] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:14.480264 28232 raft_consensus.cc:504] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.480425 28232 leader_election.cc:288] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 election: Requested vote from peers bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471), 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965)
I20260810 04:51:14.480654 27526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cf589cf12741a8a1007518bada55a1" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34954b6eebeb4687862b4fb18190333e"
I20260810 04:51:14.480785 27526 raft_consensus.cc:3037] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:14.480775 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cf589cf12741a8a1007518bada55a1" candidate_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc902a77ff01450887bfe1a32d856db8"
I20260810 04:51:14.480894 27735 raft_consensus.cc:3037] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:14.481670 27735 raft_consensus.cc:2454] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 1.
I20260810 04:51:14.481745 27526 raft_consensus.cc:2454] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d1f1ece789649f5bfe1c7a8f9a9dbdb in term 1.
I20260810 04:51:14.481915 27855 leader_election.cc:302] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, bc902a77ff01450887bfe1a32d856db8; no voters:
I20260810 04:51:14.482044 28232 raft_consensus.cc:2781] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:14.482247 28232 raft_consensus.cc:686] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 LEADER]: Becoming Leader. State: Replica: 6d1f1ece789649f5bfe1c7a8f9a9dbdb, State: Running, Role: LEADER
I20260810 04:51:14.482311 28232 consensus_queue.cc:237] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } }
I20260810 04:51:14.482788 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.482622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:41123)
0810 04:51:14.482690 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.482741 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:51:14.483507 27331 catalog_manager.cc:5495] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195). New cstate: current_term: 1 leader_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d1f1ece789649f5bfe1c7a8f9a9dbdb" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 } health_report { overall_health: UNKNOWN } } }
I20260810 04:51:14.502622 28221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.500137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.15.239.195:38749)
0810 04:51:14.500211 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:14.500214 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:14.500223 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:51:14.500258 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:14.500259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:14.500270 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:14.500334 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:14.500504 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.501046 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.501874 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:14.502093 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:14.502173 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:14.502319 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:14.502359 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:14.502419 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:14.502476 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 04:51:14.502506 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:51:14.503892 27526 raft_consensus.cc:1261] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Refusing update from remote peer 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:14.503917 27735 raft_consensus.cc:1261] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Refusing update from remote peer 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:14.504251 28235 consensus_queue.cc:1035] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34954b6eebeb4687862b4fb18190333e" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:14.504416 28232 consensus_queue.cc:1035] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc902a77ff01450887bfe1a32d856db8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:14.505990 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.505654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:40433)
0810 04:51:14.505900 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.505943 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220}
I20260810 04:51:14.506193 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.505795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:33859)
0810 04:51:14.506115 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.506153 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300}
I20260810 04:51:14.506873 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.506747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:38509)
0810 04:51:14.506791 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.506829 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260810 04:51:14.507063 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.506927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.193:51059)
0810 04:51:14.506985 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.507022 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 04:51:14.507157 28239 mvcc.cc:205] Tried to move back new op lower bound from 7316838295565533184 to 7316838295481217024. Current Snapshot: MvccSnapshot[applied={T|T < 7316838295565533184}]
I20260810 04:51:14.507637 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.507540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.195:41807)
0810 04:51:14.507580 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.507605 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260810 04:51:14.507835 28241 mvcc.cc:205] Tried to move back new op lower bound from 7316838295565533184 to 7316838295481217024. Current Snapshot: MvccSnapshot[applied={T|T < 7316838295565533184}]
I20260810 04:51:14.507946 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.507856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42783 (local address 127.15.239.194:46755)
0810 04:51:14.507891 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.507916 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:42783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 04:51:14.510048 27334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:14.510157 27334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:14.511701 27334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37e0f8a7242648b8b5caa484cfd55e07: Sending DeleteTablet for 3 replicas of tablet 76cf589cf12741a8a1007518bada55a1
I20260810 04:51:14.512108 27934 tablet_service.cc:1514] Processing DeleteTablet for tablet 76cf589cf12741a8a1007518bada55a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:14 UTC) from {username='oryx', principal='oryx/127.15.239.252@KRBTEST.COM'} at 127.0.0.1:52368
I20260810 04:51:14.512135 27502 tablet_service.cc:1514] Processing DeleteTablet for tablet 76cf589cf12741a8a1007518bada55a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:14 UTC) from {username='oryx', principal='oryx/127.15.239.252@KRBTEST.COM'} at 127.0.0.1:52240
I20260810 04:51:14.512161 27704 tablet_service.cc:1514] Processing DeleteTablet for tablet 76cf589cf12741a8a1007518bada55a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:14 UTC) from {username='oryx', principal='oryx/127.15.239.252@KRBTEST.COM'} at 127.0.0.1:52836
I20260810 04:51:14.512329 28251 tablet_replica.cc:330] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: stopping tablet replica
I20260810 04:51:14.512399 28251 raft_consensus.cc:2229] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:14.512428 28254 tablet_replica.cc:330] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: stopping tablet replica
I20260810 04:51:14.512506 28251 raft_consensus.cc:2258] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:14.512530 28253 tablet_replica.cc:330] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e: stopping tablet replica
I20260810 04:51:14.512606 28253 raft_consensus.cc:2229] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:14.512669 28253 raft_consensus.cc:2258] T 76cf589cf12741a8a1007518bada55a1 P 34954b6eebeb4687862b4fb18190333e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:14.512683 28254 raft_consensus.cc:2229] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:14.512827 28254 raft_consensus.cc:2258] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:14.512874 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 27271
I20260810 04:51:14.513062 28251 ts_tablet_manager.cc:1905] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:14.518462 28251 ts_tablet_manager.cc:1918] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:14.518560 28251 log.cc:1196] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/76cf589cf12741a8a1007518bada55a1
I20260810 04:51:14.518851 28251 ts_tablet_manager.cc:1939] T 76cf589cf12741a8a1007518bada55a1 P 6d1f1ece789649f5bfe1c7a8f9a9dbdb: Deleting consensus metadata
I20260810 04:51:14.519251 27311 catalog_manager.cc:4841] TS 6d1f1ece789649f5bfe1c7a8f9a9dbdb (127.15.239.195:38749): tablet 76cf589cf12741a8a1007518bada55a1 (table test-table [id=7e79336ee69e4429bb3d483746d32c7d]) successfully deleted
I20260810 04:51:14.523808 28254 ts_tablet_manager.cc:1905] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:14.526114 28254 ts_tablet_manager.cc:1918] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:14.526192 28254 log.cc:1196] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/76cf589cf12741a8a1007518bada55a1
I20260810 04:51:14.526450 28254 ts_tablet_manager.cc:1939] T 76cf589cf12741a8a1007518bada55a1 P bc902a77ff01450887bfe1a32d856db8: Deleting consensus metadata
I20260810 04:51:14.526978 27311 catalog_manager.cc:4841] TS bc902a77ff01450887bfe1a32d856db8 (127.15.239.194:37471): tablet 76cf589cf12741a8a1007518bada55a1 (table test-table [id=7e79336ee69e4429bb3d483746d32c7d]) successfully deleted
I20260810 04:51:14.533366 28218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:14.533193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:32965 (local address 127.0.0.1:52242)
0810 04:51:14.533266 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:14.533304 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:32965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:51:14.533356 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 27609
W20260810 04:51:14.539403 27306 catalog_manager.cc:4584] TS 34954b6eebeb4687862b4fb18190333e (127.15.239.193:32965): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 76cf589cf12741a8a1007518bada55a1: Network error: Client connection negotiation failed: client connection to 127.15.239.193:32965: connect: Connection refused (error 111)
I20260810 04:51:14.548274 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 27816
I20260810 04:51:14.567004 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 26837
I20260810 04:51:14.585654 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 27129
2026-08-10T04:51:14Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7372 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:14 dist-test-slave-kvfs krb5kdc[28257](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:14 dist-test-slave-kvfs krb5kdc[28257](info): set up 2 sockets
Aug 10 04:51:14 dist-test-slave-kvfs krb5kdc[28257](info): commencing operation
krb5kdc: starting...
W20260810 04:51:15.917917 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab.
Entry for principal oryx/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab.
I20260810 04:51:16.062927 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41121
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab
--principal=oryx/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:41121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:16.165057 28277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:16.165383 28277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:16.165431 28277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:16.166774 28277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:16.166846 28277 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 04:51:16.166869 28277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:16.166893 28277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:16.166920 28277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:16.166950 28277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:16.168780 28277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:41121
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.254.keytab
--principal=oryx/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:16.169148 28277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:16.169512 28277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:16.175977 28284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:16.175956 28288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:16.175997 28277 server_base.cc:1034] running on GCE node
W20260810 04:51:16.175961 28285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:16.176601 28277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:16.176980 28277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:16.178153 28277 hybrid_clock.cc:648] HybridClock initialized: now 1786337476178133 us; error 38 us; skew 500 ppm
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:16.182155 28277 init.cc:377] Logged in from keytab as oryx/127.15.239.254@KRBTEST.COM (short username oryx)
I20260810 04:51:16.182991 28277 webserver.cc:460] Webserver started at http://127.15.239.254:43865/ using document root <none> and password file <none>
I20260810 04:51:16.183367 28277 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:16.183450 28277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:16.183629 28277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:16.185036 28277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "2472f3ad3f29479684f2cea489e7141e"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "1832a7134c19022b39544861cb75a6bc"
server_key_iv: "eee5a6d693a4466b845bba3b4f170c92"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.185487 28277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "2472f3ad3f29479684f2cea489e7141e"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "1832a7134c19022b39544861cb75a6bc"
server_key_iv: "eee5a6d693a4466b845bba3b4f170c92"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.187209 28277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:16.188308 28303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.188519 28277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:16.188663 28277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "2472f3ad3f29479684f2cea489e7141e"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "1832a7134c19022b39544861cb75a6bc"
server_key_iv: "eee5a6d693a4466b845bba3b4f170c92"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.188758 28277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:16.200618 28277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:16.203189 28277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:16.203394 28277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:16.209465 28277 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:41121
I20260810 04:51:16.209510 28392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:41121 every 8 connection(s)
I20260810 04:51:16.209959 28277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:16.210728 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 28277
I20260810 04:51:16.210839 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:16.210985 28394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:16.211169 16319 external_mini_cluster.cc:1428] Setting key 32188d3966332801137e624be15f8c96
I20260810 04:51:16.214730 28394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Bootstrap starting.
I20260810 04:51:16.215591 28394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:16.215943 28394 log.cc:824] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:16.216928 28394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: No bootstrap required, opened a new log
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:16.219542 28394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2472f3ad3f29479684f2cea489e7141e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41121 } }
I20260810 04:51:16.219774 28394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:16.219818 28394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2472f3ad3f29479684f2cea489e7141e, State: Initialized, Role: FOLLOWER
I20260810 04:51:16.220055 28394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2472f3ad3f29479684f2cea489e7141e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41121 } }
I20260810 04:51:16.220182 28394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:16.220237 28394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:16.220314 28394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:16.221231 28394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2472f3ad3f29479684f2cea489e7141e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41121 } }
I20260810 04:51:16.221374 28394 leader_election.cc:302] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2472f3ad3f29479684f2cea489e7141e; no voters:
I20260810 04:51:16.221608 28394 leader_election.cc:288] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:16.221650 28403 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:16.221776 28403 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [term 1 LEADER]: Becoming Leader. State: Replica: 2472f3ad3f29479684f2cea489e7141e, State: Running, Role: LEADER
I20260810 04:51:16.221987 28394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:16.221946 28403 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2472f3ad3f29479684f2cea489e7141e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41121 } }
I20260810 04:51:16.222561 28404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2472f3ad3f29479684f2cea489e7141e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2472f3ad3f29479684f2cea489e7141e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41121 } } }
I20260810 04:51:16.222882 28404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:16.222780 28405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2472f3ad3f29479684f2cea489e7141e. Latest consensus state: current_term: 1 leader_uuid: "2472f3ad3f29479684f2cea489e7141e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2472f3ad3f29479684f2cea489e7141e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41121 } } }
I20260810 04:51:16.223417 28405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:16.223430 28417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:16.224170 28417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:16.224220 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.211823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39558 (local address 127.15.239.254:41121)
0810 04:51:16.212088 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.212101 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.212140 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:51:16.212586 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.212594 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.212649 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.212814 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.213565 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.214603 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.215480 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.216009 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.216177 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.219396 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.219402 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.219402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.219418 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.221690 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.222160 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.222164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.222165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.222283 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.222545 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.222546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.222546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.222956 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.223133 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.223781 (+ 648us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.223967 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
I20260810 04:51:16.226161 28417 catalog_manager.cc:1347] Generated new cluster ID: 8fbe3ba8dbd14e06a8d7ddc468bc80d6
I20260810 04:51:16.226236 28417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:16.277591 28417 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:16.278245 28417 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:16.289392 28417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Generated new TSK 0
I20260810 04:51:16.289674 28417 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab.
Entry for principal oryx/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab.
I20260810 04:51:16.331590 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41121
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:16.432188 28433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:16.432451 28433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:16.432480 28433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:16.433713 28433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:16.433748 28433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:16.433775 28433 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:51:16.433796 28433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:16.435387 28433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:16.435629 28433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:16.435874 28433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:16.441969 28444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:16.442111 28433 server_base.cc:1034] running on GCE node
W20260810 04:51:16.441962 28438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:16.441960 28446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:16.442564 28433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:16.442871 28433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:16.444074 28433 hybrid_clock.cc:648] HybridClock initialized: now 1786337476444065 us; error 51 us; skew 500 ppm
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:16.447105 28433 init.cc:377] Logged in from keytab as oryx/127.15.239.193@KRBTEST.COM (short username oryx)
I20260810 04:51:16.447759 28433 webserver.cc:460] Webserver started at http://127.15.239.193:41309/ using document root <none> and password file <none>
I20260810 04:51:16.448138 28433 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:16.448220 28433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:16.448417 28433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:16.449747 28433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "a9eac43a787840b5b2de26b958c9a8a5"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "15ec85d70bcd0f28c8cda1bd9b7a9126"
server_key_iv: "e1e098ef4a14ad53cda8a5ab51eb0911"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.450191 28433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "a9eac43a787840b5b2de26b958c9a8a5"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "15ec85d70bcd0f28c8cda1bd9b7a9126"
server_key_iv: "e1e098ef4a14ad53cda8a5ab51eb0911"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.451824 28433 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:51:16.452811 28456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.452999 28433 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:16.453130 28433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "a9eac43a787840b5b2de26b958c9a8a5"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "15ec85d70bcd0f28c8cda1bd9b7a9126"
server_key_iv: "e1e098ef4a14ad53cda8a5ab51eb0911"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.453217 28433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:16.464831 28433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:16.467012 28433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:16.467201 28433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:16.467854 28433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:16.467919 28433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.467963 28433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:16.468004 28433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.476828 28433 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:40403
I20260810 04:51:16.476938 28635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:40403 every 8 connection(s)
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:16.477375 28433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:16.479664 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 28433
I20260810 04:51:16.479804 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:16.480165 16319 external_mini_cluster.cc:1428] Setting key 3fc6affd21e72502e2e78b97b150bb0c
I20260810 04:51:16.481463 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.468381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:59361 (local address 127.15.239.254:41121)
0810 04:51:16.468458 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.468461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.468687 (+ 226us) server_negotiation.cc:407] Connection header received
0810 04:51:16.469416 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.469418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.469434 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.469505 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.470441 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.471346 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.473299 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.473685 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.473773 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.477888 (+ 4115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.477890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.477890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.477901 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.479531 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.480142 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.480144 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.480144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.480220 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.480571 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.480573 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.480573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.480744 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.480804 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.481192 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.481309 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:51:16.481542 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.468361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.15.239.193:59361)
0810 04:51:16.468537 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.468584 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.469287 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.469594 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.469598 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.470020 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:16.470341 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.470347 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.471498 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.471500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.473188 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.473193 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.473823 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.473825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.474029 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.475427 (+ 1398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:16.475441 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:16.477745 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:16.479628 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.479638 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.479641 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.480054 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.480306 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.480308 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.480308 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.480463 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.480809 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:16.480817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:16.481014 (+ 197us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.481137 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.481312 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":108,"threads_started":1}
I20260810 04:51:16.482102 28637 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41121
I20260810 04:51:16.482214 28637 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:16.482451 28637 heartbeater.cc:511] Master 127.15.239.254:41121 requested a full tablet report, sending...
I20260810 04:51:16.483114 28324 ts_manager.cc:194] Registered new tserver with Master: a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403)
I20260810 04:51:16.483985 28324 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:59361
I20260810 04:51:16.489820 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.483325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:39531 (local address 127.15.239.254:41121)
0810 04:51:16.483373 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.483376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.483548 (+ 172us) server_negotiation.cc:407] Connection header received
0810 04:51:16.483656 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.483657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.483670 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.483701 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.484213 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.484973 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.485842 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.486055 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.486139 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.487139 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.487140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.487140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.487148 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.488635 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.488988 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.488989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.488989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.489053 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.489255 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.489256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.489257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.489381 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.489458 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.489631 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.489708 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:51:16.489820 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.483322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.15.239.193:39531)
0810 04:51:16.483461 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.483483 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.483579 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.483767 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.483768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.484011 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:16.484119 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.484121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.485109 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.485110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.485749 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.485751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.486140 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.486141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.486211 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.486704 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:16.486709 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:16.487033 (+ 324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:16.488727 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.488729 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.488729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.488910 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.489120 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.489121 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.489122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.489185 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.489447 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:16.489448 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:16.489512 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.489589 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.489709 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for oryx/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab.
Entry for principal oryx/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab.
I20260810 04:51:16.511868 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41121
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:16.608946 28649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:16.609225 28649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:16.609251 28649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:16.610584 28649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:16.610639 28649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:16.610661 28649 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:51:16.610679 28649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:16.612418 28649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:16.612722 28649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:16.613001 28649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:16.618846 28660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:16.618846 28654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:16.618877 28655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:16.619271 28649 server_base.cc:1034] running on GCE node
I20260810 04:51:16.619580 28649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:16.619868 28649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:16.621043 28649 hybrid_clock.cc:648] HybridClock initialized: now 1786337476621036 us; error 54 us; skew 500 ppm
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:16.624502 28649 init.cc:377] Logged in from keytab as oryx/127.15.239.194@KRBTEST.COM (short username oryx)
I20260810 04:51:16.625022 28649 webserver.cc:460] Webserver started at http://127.15.239.194:46577/ using document root <none> and password file <none>
I20260810 04:51:16.625298 28649 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:16.625371 28649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:16.625532 28649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:16.626796 28649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "1d79e36dbe8bf0ca63bc072ae763f9e1"
server_key_iv: "efd3fb9eb9cdde7041abd990de5b0a6c"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.627220 28649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "1d79e36dbe8bf0ca63bc072ae763f9e1"
server_key_iv: "efd3fb9eb9cdde7041abd990de5b0a6c"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.628942 28649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:51:16.629765 28681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.629983 28649 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:16.630100 28649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "1d79e36dbe8bf0ca63bc072ae763f9e1"
server_key_iv: "efd3fb9eb9cdde7041abd990de5b0a6c"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.630187 28649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:16.659312 28649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:16.662048 28649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:16.662200 28649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:16.662875 28649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:16.662952 28649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.662998 28649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:16.663025 28649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.671680 28649 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:42743
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:16.671764 28882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:42743 every 8 connection(s)
I20260810 04:51:16.672221 28649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:16.675300 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.663717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:45437 (local address 127.15.239.254:41121)
0810 04:51:16.663794 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.663798 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.664090 (+ 292us) server_negotiation.cc:407] Connection header received
0810 04:51:16.664784 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.664786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.664802 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.664871 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.665929 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.666877 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.668814 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.669165 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.669243 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.672403 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.672405 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.672406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.672418 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.673933 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.674357 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.674358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.674358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.674419 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.674607 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.674608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.674608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.674735 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.674788 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.675143 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.675222 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:51:16.675557 28700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.663697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.15.239.194:45437)
0810 04:51:16.663906 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.663951 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.664652 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.664976 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.664982 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.665443 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:16.665826 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.665833 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.667021 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.667023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.668709 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.668713 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.669265 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.669266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.669471 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.670289 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:16.670307 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:16.672247 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:16.674015 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.674023 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.674026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.674280 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.674458 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.674458 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.674459 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.674554 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.674840 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:16.674847 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:16.675008 (+ 161us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.675108 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.675260 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260810 04:51:16.676245 28884 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41121
I20260810 04:51:16.676345 28884 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:16.676585 28884 heartbeater.cc:511] Master 127.15.239.254:41121 requested a full tablet report, sending...
I20260810 04:51:16.677070 28324 ts_manager.cc:194] Registered new tserver with Master: 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:16.677591 28324 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:45437
I20260810 04:51:16.679214 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 28649
I20260810 04:51:16.679347 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:16.679597 16319 external_mini_cluster.cc:1428] Setting key 3753c94794a1dae049962d00cd49d3cb
I20260810 04:51:16.684286 28893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.677496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.15.239.194:33675)
0810 04:51:16.677677 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.677690 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.677761 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.677900 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.677901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.678112 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:16.678187 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.678188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.678947 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.678948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.679642 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.679644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.680120 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.680125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.680191 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.680674 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:16.680679 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:16.681037 (+ 358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:16.683022 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.683023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.683023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.683260 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.683477 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.683477 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.683478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.683536 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.683954 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:16.683955 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:16.683997 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.684101 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.684200 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
I20260810 04:51:16.684389 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.677573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:33675 (local address 127.15.239.254:41121)
0810 04:51:16.677624 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.677626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.677743 (+ 117us) server_negotiation.cc:407] Connection header received
0810 04:51:16.677824 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.677825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.677836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.677889 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.678283 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.678843 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.679741 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.680010 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.680117 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.681141 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.681143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.681143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.681152 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.682926 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.683319 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.683321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.683322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.683406 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.683600 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.683600 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.683601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.683875 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.683961 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.684139 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.684237 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for oryx/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab.
Entry for principal oryx/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab.
I20260810 04:51:16.715508 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:41121
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:16.811776 28896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:16.812093 28896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:16.812136 28896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:16.813371 28896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:16.813441 28896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:16.813473 28896 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 04:51:16.813503 28896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:16.815299 28896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.239.254:41121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:16.815605 28896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:16.815877 28896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:16.821910 28906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:16.821893 28903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:16.821890 28904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:16.822064 28896 server_base.cc:1034] running on GCE node
I20260810 04:51:16.822464 28896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:16.822749 28896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:16.823947 28896 hybrid_clock.cc:648] HybridClock initialized: now 1786337476823913 us; error 54 us; skew 500 ppm
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:16.827301 28896 init.cc:377] Logged in from keytab as oryx/127.15.239.195@KRBTEST.COM (short username oryx)
I20260810 04:51:16.827893 28896 webserver.cc:460] Webserver started at http://127.15.239.195:46795/ using document root <none> and password file <none>
I20260810 04:51:16.828222 28896 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:16.828276 28896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:16.828415 28896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:16.829758 28896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "7894d6fd6f5d4e6fae719fe1f43bd813"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "188ba9f51be7b165e432ec3ebb880800"
server_key_iv: "1d17931816a0b120b54f71a5e5701bbd"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.830134 28896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "7894d6fd6f5d4e6fae719fe1f43bd813"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "188ba9f51be7b165e432ec3ebb880800"
server_key_iv: "1d17931816a0b120b54f71a5e5701bbd"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.831655 28896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:16.832656 28916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.832911 28896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:16.833060 28896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "7894d6fd6f5d4e6fae719fe1f43bd813"
format_stamp: "Formatted at 2026-08-10 04:51:16 on dist-test-slave-kvfs"
server_key: "188ba9f51be7b165e432ec3ebb880800"
server_key_iv: "1d17931816a0b120b54f71a5e5701bbd"
server_key_version: "encryptionkey@0"
I20260810 04:51:16.833155 28896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:16.847267 28896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:16.850142 28896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:16.850348 28896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:16.851101 28896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:16.851166 28896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:16.851205 28896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:16.851233 28896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:16.860092 28896 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:38863
I20260810 04:51:16.860175 29110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:38863 every 8 connection(s)
I20260810 04:51:16.860599 28896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:16.863085 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.851761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:47335 (local address 127.15.239.254:41121)
0810 04:51:16.851879 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.851882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.852136 (+ 254us) server_negotiation.cc:407] Connection header received
0810 04:51:16.852857 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.852859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.852878 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.852942 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.853752 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.854354 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.855496 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.855742 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.855834 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.859790 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.859793 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.859793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.859807 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.861605 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.862004 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.862005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.862006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.862067 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.862314 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.862315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.862315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.862449 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.862508 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.862912 (+ 404us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.863000 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 04:51:16.863157 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 28896
I20260810 04:51:16.863272 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:16.863366 28927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.851731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.15.239.195:47335)
0810 04:51:16.851944 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.851994 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.852698 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.853042 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.853047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.853383 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:16.853635 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.853641 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.854474 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.854475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.855396 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.855399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.855846 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.855847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.856081 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.856865 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:16.856875 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:16.859638 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:16.861682 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.861688 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.861690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.861929 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.862126 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.862127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.862127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.862236 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.862544 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:16.862551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:16.862703 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.862817 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.863076 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
I20260810 04:51:16.863565 16319 external_mini_cluster.cc:1428] Setting key 32a183df31cd9b4fce18c61491a2222a
I20260810 04:51:16.864136 29112 heartbeater.cc:347] Connected to a master server at 127.15.239.254:41121
I20260810 04:51:16.864230 29112 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:16.864478 29112 heartbeater.cc:511] Master 127.15.239.254:41121 requested a full tablet report, sending...
I20260810 04:51:16.864959 28324 ts_manager.cc:194] Registered new tserver with Master: 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863)
I20260810 04:51:16.865447 28324 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:47335
I20260810 04:51:16.871280 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.865628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:54733 (local address 127.15.239.254:41121)
0810 04:51:16.865698 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.865700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.865957 (+ 257us) server_negotiation.cc:407] Connection header received
0810 04:51:16.866002 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.866003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.866017 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.866085 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.866407 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.866933 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.867677 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.867873 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.867928 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.868986 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.868988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.868988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.868995 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.870215 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.870555 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.870556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.870557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.870625 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.870858 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.870859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.870859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.870972 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.871025 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.871146 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.871209 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 04:51:16.871315 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.865556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.15.239.195:54733)
0810 04:51:16.865877 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.865887 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.865959 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.866086 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.866087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.866270 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:16.866333 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.866341 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.867044 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.867045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.867605 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.867607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.867937 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.867938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.867991 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.868562 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:16.868567 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:16.868885 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:16.870292 (+ 1407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.870293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.870294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.870476 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.870707 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:16.870708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:16.870709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:16.870781 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:16.871032 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:16.871033 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:16.871074 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.871131 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.871234 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":84,"threads_started":1}
I20260810 04:51:16.875804 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:51:16.903836 28400 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:16.897447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39572 (local address 127.15.239.254:41121)
0810 04:51:16.897523 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.897525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.897536 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:16.897579 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.897581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.897592 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.897660 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.898358 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.898947 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.899804 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.900091 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.900184 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.903696 (+ 3512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39572: BlockingRecv error: recv got EOF from 127.0.0.1:39572 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 04:51:16 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:16.912163 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.904670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39586 (local address 127.15.239.254:41121)
0810 04:51:16.904746 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.904749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.904869 (+ 120us) server_negotiation.cc:407] Connection header received
0810 04:51:16.904969 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.904970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.904981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.905025 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:16.905512 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.906035 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.906726 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.906935 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.907020 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.909410 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:16.909412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:16.909412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:16.909420 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:16.910825 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.911248 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.911249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.911250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.911318 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:16.911530 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:16.911531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:16.911531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:16.911680 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:16.911802 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.911907 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.912014 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 04:51:16.914280 28324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:16.916394 28324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:16.924407 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.919370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:40403 (local address 127.0.0.1:52080)
0810 04:51:16.919689 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.919743 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.919831 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.920363 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.920364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.920370 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:16.920456 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.920459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.921869 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.921870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.923027 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.923030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.923947 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.923948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.924098 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.924117 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.924216 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.924285 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":6,"thread_start_us":131,"threads_started":1}
I20260810 04:51:16.924616 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.919369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38863 (local address 127.0.0.1:35624)
0810 04:51:16.919790 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.919803 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.919866 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.920363 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.920364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.920366 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:16.920456 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.920458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.921568 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.921569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.923082 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.923084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.924168 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.924169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.924298 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.924302 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.924356 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.924396 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":33,"thread_start_us":60,"threads_started":1}
I20260810 04:51:16.924726 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.919368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42743 (local address 127.0.0.1:59220)
0810 04:51:16.919871 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:16.919881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:16.919933 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:16.920297 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:16.920301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:16.920304 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:16.920398 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.920400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.921820 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.921820 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.923079 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:16.923083 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.924281 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.924282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:16.924356 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.924362 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:51:16.924413 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 04:51:16.924479 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":8,"thread_start_us":135,"threads_started":1}
I20260810 04:51:16.924875 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.919692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59220 (local address 127.15.239.194:42743)
0810 04:51:16.920066 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.920072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.920084 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:16.920138 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.920140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.920159 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.920467 (+ 308us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:16.920549 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.921729 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.923205 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.923983 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.924183 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.924248 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.924689 (+ 441us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.924745 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":121,"threads_started":1}
I20260810 04:51:16.924961 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.919531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52080 (local address 127.15.239.193:40403)
0810 04:51:16.920104 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.920108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.920119 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:16.920163 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.920165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.920182 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.920268 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:16.920551 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.921793 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.923125 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.923846 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.923974 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.924079 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.924781 (+ 702us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.924836 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":123,"threads_started":1}
I20260810 04:51:16.925141 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:16.919682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35624 (local address 127.15.239.195:38863)
0810 04:51:16.920079 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:16.920085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:16.920096 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:16.920157 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:16.920159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:16.920177 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:16.920268 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:16.920564 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.921485 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.923195 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:16.923996 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:16.924177 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:16.924248 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:16.924456 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 04:51:16.925019 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":107,"threads_started":1}
I20260810 04:51:16.925882 28766 tablet_service.cc:1467] Processing CreateTablet for tablet 191a40758d9d4a02a4b3a7914607acca (DEFAULT_TABLE table=test-table [id=5c5f47a56e734e9490338ed4ab3d1277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:16.925889 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 191a40758d9d4a02a4b3a7914607acca (DEFAULT_TABLE table=test-table [id=5c5f47a56e734e9490338ed4ab3d1277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:16.925889 29001 tablet_service.cc:1467] Processing CreateTablet for tablet 191a40758d9d4a02a4b3a7914607acca (DEFAULT_TABLE table=test-table [id=5c5f47a56e734e9490338ed4ab3d1277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:16.926352 28766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 191a40758d9d4a02a4b3a7914607acca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:16.926355 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 191a40758d9d4a02a4b3a7914607acca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:16.926355 29001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 191a40758d9d4a02a4b3a7914607acca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:16.930521 29167 tablet_bootstrap.cc:492] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Bootstrap starting.
I20260810 04:51:16.930963 29168 tablet_bootstrap.cc:492] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Bootstrap starting.
I20260810 04:51:16.931727 29167 tablet_bootstrap.cc:654] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:16.931727 29168 tablet_bootstrap.cc:654] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:16.932204 29167 log.cc:824] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:16.932204 29168 log.cc:824] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:16.932236 29169 tablet_bootstrap.cc:492] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Bootstrap starting.
I20260810 04:51:16.933027 29169 tablet_bootstrap.cc:654] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:16.933120 29168 tablet_bootstrap.cc:492] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: No bootstrap required, opened a new log
I20260810 04:51:16.933128 29167 tablet_bootstrap.cc:492] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: No bootstrap required, opened a new log
I20260810 04:51:16.933202 29168 ts_tablet_manager.cc:1397] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:51:16.933207 29167 ts_tablet_manager.cc:1397] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:51:16.933420 29169 log.cc:824] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:16.934288 29169 tablet_bootstrap.cc:492] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: No bootstrap required, opened a new log
I20260810 04:51:16.934363 29169 ts_tablet_manager.cc:1397] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:51:16.935457 29168 raft_consensus.cc:348] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:16.935673 29168 raft_consensus.cc:374] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:16.935585 29167 raft_consensus.cc:348] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:16.935724 29168 raft_consensus.cc:729] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Initialized, Role: FOLLOWER
I20260810 04:51:16.935745 29167 raft_consensus.cc:374] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:16.935776 29167 raft_consensus.cc:729] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f55b3b4554a48bb81b4d344ecfe5223, State: Initialized, Role: FOLLOWER
I20260810 04:51:16.935856 29168 consensus_queue.cc:260] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:16.935899 29167 consensus_queue.cc:260] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:16.936244 29168 ts_tablet_manager.cc:1428] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:51:16.936256 29167 ts_tablet_manager.cc:1428] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260810 04:51:16.936396 29112 heartbeater.cc:503] Master 127.15.239.254:41121 was elected leader, sending a full tablet report...
I20260810 04:51:16.936753 28884 heartbeater.cc:503] Master 127.15.239.254:41121 was elected leader, sending a full tablet report...
I20260810 04:51:16.936738 29169 raft_consensus.cc:348] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:16.936906 29169 raft_consensus.cc:374] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:16.936947 29169 raft_consensus.cc:729] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Initialized, Role: FOLLOWER
I20260810 04:51:16.937064 29169 consensus_queue.cc:260] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:16.937350 29169 ts_tablet_manager.cc:1428] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:51:16.937441 28637 heartbeater.cc:503] Master 127.15.239.254:41121 was elected leader, sending a full tablet report...
W20260810 04:51:16.978366 28639 tablet.cc:2369] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:51:17.032092 29175 raft_consensus.cc:482] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:17.032402 29175 raft_consensus.cc:504] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.032968 29175 leader_election.cc:288] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.036579 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.033321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:58407 (local address 127.15.239.194:42743)
0810 04:51:17.033384 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.033387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.033508 (+ 121us) server_negotiation.cc:407] Connection header received
0810 04:51:17.033588 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.033589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.033603 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.033654 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:17.033895 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.034523 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.035608 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.036153 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.036237 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.036250 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.036443 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.036491 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 04:51:17.036595 29177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.033221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42743 (local address 127.15.239.193:58407)
0810 04:51:17.033409 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.033422 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.033507 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.033675 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.033676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.033679 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:17.033815 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.033818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.034626 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.034627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.035512 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.035514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.036254 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.036255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.036366 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.036372 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.036422 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.036479 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":57,"thread_start_us":90,"threads_started":1}
I20260810 04:51:17.036687 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.033386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:42243 (local address 127.15.239.195:38863)
0810 04:51:17.033468 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.033470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.033483 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:51:17.033608 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.033609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.033618 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.033691 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:17.033919 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.034512 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.035606 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.036209 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.036293 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.036303 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.036554 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.036604 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 04:51:17.036717 29178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.033221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38863 (local address 127.15.239.193:42243)
0810 04:51:17.033408 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.033420 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.033515 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.033712 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.033713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.033716 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:17.033816 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.033818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.034591 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.034592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.035512 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.035515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.036313 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.036314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.036418 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.036423 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.036545 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.036592 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":43,"thread_start_us":90,"threads_started":1}
I20260810 04:51:17.037052 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "191a40758d9d4a02a4b3a7914607acca" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" is_pre_election: true
I20260810 04:51:17.037266 28801 raft_consensus.cc:2454] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 0.
I20260810 04:51:17.037554 28463 leader_election.cc:302] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, a9eac43a787840b5b2de26b958c9a8a5; no voters:
I20260810 04:51:17.037602 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "191a40758d9d4a02a4b3a7914607acca" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" is_pre_election: true
I20260810 04:51:17.037736 29175 raft_consensus.cc:2781] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:17.037774 29038 raft_consensus.cc:2454] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 0.
I20260810 04:51:17.037811 29175 raft_consensus.cc:482] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:17.037850 29175 raft_consensus.cc:3037] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.038743 29175 raft_consensus.cc:504] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.038911 29175 leader_election.cc:288] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 election: Requested vote from peers 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.039094 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "191a40758d9d4a02a4b3a7914607acca" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813"
I20260810 04:51:17.039077 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "191a40758d9d4a02a4b3a7914607acca" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
I20260810 04:51:17.039166 28801 raft_consensus.cc:3037] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.039181 29038 raft_consensus.cc:3037] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.039985 29038 raft_consensus.cc:2454] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 1.
I20260810 04:51:17.040114 28801 raft_consensus.cc:2454] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 1.
I20260810 04:51:17.040208 28459 leader_election.cc:302] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7894d6fd6f5d4e6fae719fe1f43bd813, a9eac43a787840b5b2de26b958c9a8a5; no voters:
I20260810 04:51:17.040335 29175 raft_consensus.cc:2781] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:17.040449 29175 raft_consensus.cc:686] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 1 LEADER]: Becoming Leader. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Running, Role: LEADER
I20260810 04:51:17.040563 29175 consensus_queue.cc:237] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.041543 28326 catalog_manager.cc:5495] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "a9eac43a787840b5b2de26b958c9a8a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } health_report { overall_health: UNKNOWN } } }
I20260810 04:51:17.070405 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.067678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.15.239.193:40403)
0810 04:51:17.067848 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.067850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.067858 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:17.067903 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.067904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.067929 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.068006 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:17.068230 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.068747 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.069557 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.069748 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.069801 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.069986 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.070135 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.070239 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.070266 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.070289 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260810 04:51:17.073014 28801 raft_consensus.cc:1261] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Refusing update from remote peer a9eac43a787840b5b2de26b958c9a8a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.073014 29038 raft_consensus.cc:1261] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Refusing update from remote peer a9eac43a787840b5b2de26b958c9a8a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.073418 29179 consensus_queue.cc:1035] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.073576 29175 consensus_queue.cc:1035] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.076563 29182 mvcc.cc:205] Tried to move back new op lower bound from 7316838306087710720 to 7316838305958903808. Current Snapshot: MvccSnapshot[applied={T|T < 7316838306087710720}]
I20260810 04:51:17.077454 29185 mvcc.cc:205] Tried to move back new op lower bound from 7316838306087710720 to 7316838305958903808. Current Snapshot: MvccSnapshot[applied={T|T < 7316838306087710720}]
I20260810 04:51:17.077520 29183 mvcc.cc:205] Tried to move back new op lower bound from 7316838306087710720 to 7316838305958903808. Current Snapshot: MvccSnapshot[applied={T|T < 7316838306087710720 or (T in {7316838306087710720})}]
I20260810 04:51:17.079584 28324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.079694 28324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.080571 28324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Sending DeleteTablet for 3 replicas of tablet 191a40758d9d4a02a4b3a7914607acca
I20260810 04:51:17.080937 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 191a40758d9d4a02a4b3a7914607acca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:52080
I20260810 04:51:17.080986 28766 tablet_service.cc:1514] Processing DeleteTablet for tablet 191a40758d9d4a02a4b3a7914607acca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59220
I20260810 04:51:17.081231 29198 tablet_replica.cc:330] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: stopping tablet replica
I20260810 04:51:17.081205 29001 tablet_service.cc:1514] Processing DeleteTablet for tablet 191a40758d9d4a02a4b3a7914607acca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:35624
I20260810 04:51:17.081317 29198 raft_consensus.cc:2229] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:17.081456 29201 tablet_replica.cc:330] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: stopping tablet replica
I20260810 04:51:17.081459 29198 raft_consensus.cc:2258] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.081657 29201 raft_consensus.cc:2229] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.081847 28324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 04:51:17.081981 29198 ts_tablet_manager.cc:1905] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 04:51:17.082038 28324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:17.082093 29201 raft_consensus.cc:2258] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.082643 29201 ts_tablet_manager.cc:1905] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.084159 29198 ts_tablet_manager.cc:1918] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:17.084241 29198 log.cc:1196] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/191a40758d9d4a02a4b3a7914607acca
I20260810 04:51:17.084364 28766 tablet_service.cc:1467] Processing CreateTablet for tablet 9b42f8885bb04679b7fca25fa9ac43b1 (DEFAULT_TABLE table=test-table [id=528c62b763834d73b13b0a25023cc98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.084525 28766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b42f8885bb04679b7fca25fa9ac43b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.084568 29198 ts_tablet_manager.cc:1939] T 191a40758d9d4a02a4b3a7914607acca P a9eac43a787840b5b2de26b958c9a8a5: Deleting consensus metadata
I20260810 04:51:17.084602 29201 ts_tablet_manager.cc:1918] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:17.084664 29201 log.cc:1196] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/191a40758d9d4a02a4b3a7914607acca
I20260810 04:51:17.084930 29201 ts_tablet_manager.cc:1939] T 191a40758d9d4a02a4b3a7914607acca P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting consensus metadata
I20260810 04:51:17.085035 28306 catalog_manager.cc:4841] TS a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403): tablet 191a40758d9d4a02a4b3a7914607acca (table test-table [id=5c5f47a56e734e9490338ed4ab3d1277]) successfully deleted
I20260810 04:51:17.086562 29167 tablet_bootstrap.cc:492] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Bootstrap starting.
I20260810 04:51:17.086639 28305 catalog_manager.cc:4841] TS 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863): tablet 191a40758d9d4a02a4b3a7914607acca (table test-table [id=5c5f47a56e734e9490338ed4ab3d1277]) successfully deleted
I20260810 04:51:17.086792 29001 tablet_service.cc:1467] Processing CreateTablet for tablet 9b42f8885bb04679b7fca25fa9ac43b1 (DEFAULT_TABLE table=test-table [id=528c62b763834d73b13b0a25023cc98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.086899 29001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b42f8885bb04679b7fca25fa9ac43b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.087018 29167 tablet_bootstrap.cc:654] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.087626 29167 tablet_bootstrap.cc:492] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: No bootstrap required, opened a new log
I20260810 04:51:17.087661 29167 ts_tablet_manager.cc:1397] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:17.087802 29167 raft_consensus.cc:348] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.087867 29167 raft_consensus.cc:374] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.087884 29167 raft_consensus.cc:729] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f55b3b4554a48bb81b4d344ecfe5223, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.087944 29167 consensus_queue.cc:260] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.088075 29167 ts_tablet_manager.cc:1428] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:51:17.088217 29168 tablet_bootstrap.cc:492] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Bootstrap starting.
I20260810 04:51:17.088553 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 9b42f8885bb04679b7fca25fa9ac43b1 (DEFAULT_TABLE table=test-table [id=528c62b763834d73b13b0a25023cc98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.088667 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b42f8885bb04679b7fca25fa9ac43b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.088702 29168 tablet_bootstrap.cc:654] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.089314 29168 tablet_bootstrap.cc:492] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: No bootstrap required, opened a new log
I20260810 04:51:17.089355 29168 ts_tablet_manager.cc:1397] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:17.089489 29168 raft_consensus.cc:348] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.089538 29168 raft_consensus.cc:374] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.089551 29168 raft_consensus.cc:729] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.089607 29168 consensus_queue.cc:260] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.089733 29168 ts_tablet_manager.cc:1428] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.090063 29169 tablet_bootstrap.cc:492] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Bootstrap starting.
I20260810 04:51:17.090519 29169 tablet_bootstrap.cc:654] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.091693 29169 tablet_bootstrap.cc:492] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: No bootstrap required, opened a new log
I20260810 04:51:17.091750 29169 ts_tablet_manager.cc:1397] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:51:17.091909 29169 raft_consensus.cc:348] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.091993 29169 raft_consensus.cc:374] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.092015 29169 raft_consensus.cc:729] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.092075 29169 consensus_queue.cc:260] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.092177 29169 ts_tablet_manager.cc:1428] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:51:17.092372 29199 tablet_replica.cc:330] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: stopping tablet replica
I20260810 04:51:17.092511 29199 raft_consensus.cc:2229] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.092644 29199 raft_consensus.cc:2258] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.093184 29199 ts_tablet_manager.cc:1905] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.094720 29199 ts_tablet_manager.cc:1918] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:17.094830 29199 log.cc:1196] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/191a40758d9d4a02a4b3a7914607acca
I20260810 04:51:17.095161 29199 ts_tablet_manager.cc:1939] T 191a40758d9d4a02a4b3a7914607acca P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting consensus metadata
I20260810 04:51:17.095623 28307 catalog_manager.cc:4841] TS 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743): tablet 191a40758d9d4a02a4b3a7914607acca (table test-table [id=5c5f47a56e734e9490338ed4ab3d1277]) successfully deleted
W20260810 04:51:17.111984 29115 tablet.cc:2369] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:51:17.173091 28886 tablet.cc:2369] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:51:17.225636 29179 raft_consensus.cc:482] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:17.225800 29179 raft_consensus.cc:504] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.226044 29179 leader_election.cc:288] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743), 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863)
I20260810 04:51:17.226380 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b42f8885bb04679b7fca25fa9ac43b1" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" is_pre_election: true
I20260810 04:51:17.226413 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b42f8885bb04679b7fca25fa9ac43b1" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" is_pre_election: true
I20260810 04:51:17.226528 28801 raft_consensus.cc:2454] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 0.
I20260810 04:51:17.226528 29038 raft_consensus.cc:2454] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 0.
I20260810 04:51:17.226716 28463 leader_election.cc:302] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, a9eac43a787840b5b2de26b958c9a8a5; no voters:
I20260810 04:51:17.226861 29179 raft_consensus.cc:2781] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:17.226923 29179 raft_consensus.cc:482] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:17.226953 29179 raft_consensus.cc:3037] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.227909 29179 raft_consensus.cc:504] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.228101 29179 leader_election.cc:288] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 election: Requested vote from peers 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743), 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863)
I20260810 04:51:17.228283 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b42f8885bb04679b7fca25fa9ac43b1" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
I20260810 04:51:17.228282 29038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b42f8885bb04679b7fca25fa9ac43b1" candidate_uuid: "a9eac43a787840b5b2de26b958c9a8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813"
I20260810 04:51:17.228389 28801 raft_consensus.cc:3037] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.228384 29038 raft_consensus.cc:3037] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.229187 29038 raft_consensus.cc:2454] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 1.
I20260810 04:51:17.229285 28801 raft_consensus.cc:2454] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9eac43a787840b5b2de26b958c9a8a5 in term 1.
I20260810 04:51:17.229363 28459 leader_election.cc:302] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7894d6fd6f5d4e6fae719fe1f43bd813, a9eac43a787840b5b2de26b958c9a8a5; no voters:
I20260810 04:51:17.229460 29179 raft_consensus.cc:2781] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:17.229516 29179 raft_consensus.cc:686] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 LEADER]: Becoming Leader. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Running, Role: LEADER
I20260810 04:51:17.229560 29179 consensus_queue.cc:237] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.230257 28324 catalog_manager.cc:5495] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "a9eac43a787840b5b2de26b958c9a8a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } health_report { overall_health: UNKNOWN } } }
Aug 10 04:51:17 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337476, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.254@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:17.265233 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.257310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39600 (local address 127.15.239.254:41121)
0810 04:51:17.257379 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.257382 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.257527 (+ 145us) server_negotiation.cc:407] Connection header received
0810 04:51:17.257620 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.257620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.257632 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.257693 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:17.258261 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.258832 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.259605 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.259812 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.259906 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.262415 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:17.262417 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:17.262417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:17.262425 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:17.263803 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:17.264320 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:17.264321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:17.264322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:17.264387 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:17.264584 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:17.264585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:17.264586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:17.264733 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:17.264813 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.264987 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.265088 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:51:17.265249 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.257266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:41121 (local address 127.0.0.1:39600)
0810 04:51:17.257449 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.257462 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.257553 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.257699 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.257700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.258107 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:17.258170 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.258173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.258934 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.258936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.259519 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.259521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.259906 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.259907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.259957 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.260671 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:17.260677 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:17.262301 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:17.263928 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:17.263938 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:17.263941 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:17.264233 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:17.264453 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:17.264454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:17.264454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:17.264522 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:17.264800 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:17.264810 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:17.264862 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.264962 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.265144 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":65,"thread_start_us":133,"threads_started":1}
I20260810 04:51:17.267812 28324 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:39600:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 04:51:17.268106 28324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:17.269740 28536 tablet_service.cc:1467] Processing CreateTablet for tablet e1e67a0a14f14aeabe8bee0d1a118e9b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fd038e5ce3dd45188961d0b71dec29f0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:51:17.269781 29001 tablet_service.cc:1467] Processing CreateTablet for tablet e1e67a0a14f14aeabe8bee0d1a118e9b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fd038e5ce3dd45188961d0b71dec29f0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:51:17.269956 29001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e67a0a14f14aeabe8bee0d1a118e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.269964 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e67a0a14f14aeabe8bee0d1a118e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.271353 29168 tablet_bootstrap.cc:492] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: Bootstrap starting.
I20260810 04:51:17.271382 29169 tablet_bootstrap.cc:492] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: Bootstrap starting.
I20260810 04:51:17.271509 28766 tablet_service.cc:1467] Processing CreateTablet for tablet e1e67a0a14f14aeabe8bee0d1a118e9b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fd038e5ce3dd45188961d0b71dec29f0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 04:51:17.271708 28766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1e67a0a14f14aeabe8bee0d1a118e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.271801 29169 tablet_bootstrap.cc:654] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.271895 29168 tablet_bootstrap.cc:654] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.272642 29169 tablet_bootstrap.cc:492] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: No bootstrap required, opened a new log
I20260810 04:51:17.272686 29169 ts_tablet_manager.cc:1397] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:17.272753 29168 tablet_bootstrap.cc:492] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: No bootstrap required, opened a new log
I20260810 04:51:17.272799 29168 ts_tablet_manager.cc:1397] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:17.272789 29169 raft_consensus.cc:348] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.272850 29169 raft_consensus.cc:374] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.272866 29169 raft_consensus.cc:729] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.272927 29169 consensus_queue.cc:260] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.273036 29169 ts_tablet_manager.cc:1428] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.273007 29168 raft_consensus.cc:348] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.273082 29168 raft_consensus.cc:374] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.273051 29179 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.273100 29168 raft_consensus.cc:729] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.273128 29179 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.273156 29168 consensus_queue.cc:260] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.273255 29168 ts_tablet_manager.cc:1428] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.273322 29173 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.273437 29173 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.273710 29167 tablet_bootstrap.cc:492] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: Bootstrap starting.
I20260810 04:51:17.274156 29167 tablet_bootstrap.cc:654] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.274861 29167 tablet_bootstrap.cc:492] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: No bootstrap required, opened a new log
I20260810 04:51:17.274942 29167 ts_tablet_manager.cc:1397] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:17.275130 29167 raft_consensus.cc:348] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.275208 29167 raft_consensus.cc:374] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.275233 29167 raft_consensus.cc:729] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f55b3b4554a48bb81b4d344ecfe5223, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.275290 29167 consensus_queue.cc:260] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.275419 29167 ts_tablet_manager.cc:1428] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.275506 29174 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.275619 29174 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.390811 29173 raft_consensus.cc:482] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:17.390969 29173 raft_consensus.cc:504] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.391521 29173 leader_election.cc:288] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.394897 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.391827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:50025 (local address 127.15.239.193:40403)
0810 04:51:17.391928 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.391930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.392038 (+ 108us) server_negotiation.cc:407] Connection header received
0810 04:51:17.392161 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.392163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.392184 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.392250 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:17.392466 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.393018 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.394112 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.394507 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.394592 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.394602 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.394744 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.394791 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 04:51:17.394915 29223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.391763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42743 (local address 127.15.239.195:49107)
0810 04:51:17.391989 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.392001 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.392106 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.392261 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.392262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.392264 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:17.392368 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.392370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.393119 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.393120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.394018 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.394021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.394588 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.394589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.394674 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.394677 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.394749 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.394794 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":40,"thread_start_us":64,"threads_started":1}
I20260810 04:51:17.394894 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.391881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:49107 (local address 127.15.239.194:42743)
0810 04:51:17.391990 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.391992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.392087 (+ 95us) server_negotiation.cc:407] Connection header received
0810 04:51:17.392175 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.392177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.392191 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.392257 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:17.392439 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.393033 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.394113 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.394501 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.394590 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.394602 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.394758 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.394802 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 04:51:17.394928 29222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.391735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:40403 (local address 127.15.239.195:50025)
0810 04:51:17.391933 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.391945 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.392080 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.392254 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.392255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.392259 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:17.392386 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.392388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.393112 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.393113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.394020 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.394022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.394591 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.394592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.394669 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.394673 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.394737 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.394787 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":7,"thread_start_us":82,"threads_started":1}
I20260810 04:51:17.395294 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e67a0a14f14aeabe8bee0d1a118e9b" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" is_pre_election: true
I20260810 04:51:17.395524 28801 raft_consensus.cc:2454] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 0.
I20260810 04:51:17.395653 28568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e67a0a14f14aeabe8bee0d1a118e9b" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9eac43a787840b5b2de26b958c9a8a5" is_pre_election: true
I20260810 04:51:17.395807 28920 leader_election.cc:302] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, 7894d6fd6f5d4e6fae719fe1f43bd813; no voters:
I20260810 04:51:17.395896 28568 raft_consensus.cc:2454] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 0.
I20260810 04:51:17.395987 29173 raft_consensus.cc:2781] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:17.396072 29173 raft_consensus.cc:482] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:17.396106 29173 raft_consensus.cc:3037] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.397007 29173 raft_consensus.cc:504] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.397181 29173 leader_election.cc:288] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 election: Requested vote from peers a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.397344 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e67a0a14f14aeabe8bee0d1a118e9b" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
I20260810 04:51:17.397352 28568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1e67a0a14f14aeabe8bee0d1a118e9b" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9eac43a787840b5b2de26b958c9a8a5"
I20260810 04:51:17.397428 28801 raft_consensus.cc:3037] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.397445 28568 raft_consensus.cc:3037] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.398165 28801 raft_consensus.cc:2454] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 1.
I20260810 04:51:17.398336 28920 leader_election.cc:302] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, 7894d6fd6f5d4e6fae719fe1f43bd813; no voters:
I20260810 04:51:17.398406 28568 raft_consensus.cc:2454] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 1.
I20260810 04:51:17.398442 29173 raft_consensus.cc:2781] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:17.398604 29173 raft_consensus.cc:686] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 LEADER]: Becoming Leader. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Running, Role: LEADER
I20260810 04:51:17.398695 29173 consensus_queue.cc:237] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } }
I20260810 04:51:17.399061 29227 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: TxnStatusTablet state changed. Reason: New leader 7894d6fd6f5d4e6fae719fe1f43bd813. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.399158 29227 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:51:17.399379 29230 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 04:51:17.399544 29230 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 04:51:17.399674 28324 catalog_manager.cc:5495] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195). New cstate: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } health_report { overall_health: UNKNOWN } } }
I20260810 04:51:17.421777 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.418591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35632 (local address 127.15.239.195:38863)
0810 04:51:17.418655 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.418658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.418795 (+ 137us) server_negotiation.cc:407] Connection header received
0810 04:51:17.418877 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.418879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.418901 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.418967 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:17.419174 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.419718 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.420933 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.421129 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.421186 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.421373 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.421488 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.421546 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.421619 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.421677 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:51:17.421809 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.418528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38863 (local address 127.0.0.1:35632)
0810 04:51:17.418681 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.418695 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.418785 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.418988 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.418989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.418992 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:51:17.419067 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.419071 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.419808 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.419809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.420850 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.420854 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.421187 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.421188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.421259 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.421281 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.421550 (+ 269us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.421559 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.421616 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.421703 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260810 04:51:17.423264 28801 raft_consensus.cc:1261] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Refusing update from remote peer 7894d6fd6f5d4e6fae719fe1f43bd813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.423379 28568 raft_consensus.cc:1261] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7894d6fd6f5d4e6fae719fe1f43bd813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.423574 29227 consensus_queue.cc:1035] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.423700 29173 consensus_queue.cc:1035] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.424403 29174 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: TxnStatusTablet state changed. Reason: New leader 7894d6fd6f5d4e6fae719fe1f43bd813. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.424523 29174 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.424571 29179 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: TxnStatusTablet state changed. Reason: New leader 7894d6fd6f5d4e6fae719fe1f43bd813. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.424669 29179 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.425665 29227 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.425766 29227 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:51:17.426141 29174 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.426244 29174 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 2f55b3b4554a48bb81b4d344ecfe5223: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.429188 29173 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.429271 29173 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P 7894d6fd6f5d4e6fae719fe1f43bd813: This TxnStatusTablet replica's current role is: LEADER
I20260810 04:51:17.429539 29179 tablet_replica.cc:439] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } }
I20260810 04:51:17.429628 29179 tablet_replica.cc:442] T e1e67a0a14f14aeabe8bee0d1a118e9b P a9eac43a787840b5b2de26b958c9a8a5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 04:51:17.435145 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.432426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:38741 (local address 127.15.239.195:38863)
0810 04:51:17.432470 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.432473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.432615 (+ 142us) server_negotiation.cc:407] Connection header received
0810 04:51:17.432697 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.432699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.432711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.432786 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:17.432936 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.433451 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.434418 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.434612 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.434679 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.434871 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.434924 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.434988 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.435052 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.435074 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:51:17.435204 29245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.432376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38863 (local address 127.15.239.193:38741)
0810 04:51:17.432547 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.432557 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.432634 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.432793 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.432793 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.432795 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:51:17.432866 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.432868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.433537 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.433538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.434340 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.434343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.434691 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.434693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.434762 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.434783 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.434991 (+ 208us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.434994 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.435048 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.435106 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260810 04:51:17.437942 29038 raft_consensus.cc:1261] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Refusing update from remote peer a9eac43a787840b5b2de26b958c9a8a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.437986 28801 raft_consensus.cc:1261] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Refusing update from remote peer a9eac43a787840b5b2de26b958c9a8a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.438167 29175 consensus_queue.cc:1035] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.438264 29179 consensus_queue.cc:1035] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.448577 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.445234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:40403 (local address 127.15.239.195:42043)
0810 04:51:17.445436 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.445449 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.445539 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.445678 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.445679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.445680 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:51:17.445740 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.445742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.446683 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.446684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.447620 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.447623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.448149 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.448150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.448213 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.448230 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.448420 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.448422 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.448453 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.448489 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":115,"threads_started":1}
I20260810 04:51:17.448570 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.445294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:42043 (local address 127.15.239.193:40403)
0810 04:51:17.445338 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.445340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.445512 (+ 172us) server_negotiation.cc:407] Connection header received
0810 04:51:17.445600 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.445601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.445613 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.445674 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:17.445777 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.446561 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.447692 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.448014 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.448120 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.448317 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.448361 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.448422 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.448457 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.448485 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:51:17.456996 28324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.457144 28324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.457856 28324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Sending DeleteTablet for 3 replicas of tablet 9b42f8885bb04679b7fca25fa9ac43b1
I20260810 04:51:17.458128 29001 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b42f8885bb04679b7fca25fa9ac43b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:35624
I20260810 04:51:17.458185 28766 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b42f8885bb04679b7fca25fa9ac43b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59220
I20260810 04:51:17.458189 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b42f8885bb04679b7fca25fa9ac43b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:52080
I20260810 04:51:17.458305 29198 tablet_replica.cc:330] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: stopping tablet replica
I20260810 04:51:17.458312 29201 tablet_replica.cc:330] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: stopping tablet replica
I20260810 04:51:17.458377 29201 raft_consensus.cc:2229] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.458377 29198 raft_consensus.cc:2229] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:17.458425 29201 raft_consensus.cc:2258] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.458448 29198 raft_consensus.cc:2258] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.458534 29199 tablet_replica.cc:330] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: stopping tablet replica
I20260810 04:51:17.458614 29199 raft_consensus.cc:2229] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.458662 29199 raft_consensus.cc:2258] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.459004 29199 ts_tablet_manager.cc:1905] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.459004 29198 ts_tablet_manager.cc:1905] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.460749 29198 ts_tablet_manager.cc:1918] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:51:17.460850 29198 log.cc:1196] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/9b42f8885bb04679b7fca25fa9ac43b1
I20260810 04:51:17.460892 29199 ts_tablet_manager.cc:1918] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:51:17.460963 29199 log.cc:1196] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/9b42f8885bb04679b7fca25fa9ac43b1
I20260810 04:51:17.461103 29198 ts_tablet_manager.cc:1939] T 9b42f8885bb04679b7fca25fa9ac43b1 P a9eac43a787840b5b2de26b958c9a8a5: Deleting consensus metadata
I20260810 04:51:17.461202 29199 ts_tablet_manager.cc:1939] T 9b42f8885bb04679b7fca25fa9ac43b1 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting consensus metadata
I20260810 04:51:17.461467 28306 catalog_manager.cc:4841] TS a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403): tablet 9b42f8885bb04679b7fca25fa9ac43b1 (table test-table [id=528c62b763834d73b13b0a25023cc98d]) successfully deleted
I20260810 04:51:17.461689 28307 catalog_manager.cc:4841] TS 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743): tablet 9b42f8885bb04679b7fca25fa9ac43b1 (table test-table [id=528c62b763834d73b13b0a25023cc98d]) successfully deleted
I20260810 04:51:17.464903 29201 ts_tablet_manager.cc:1905] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.467106 29201 ts_tablet_manager.cc:1918] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:51:17.467172 29201 log.cc:1196] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/9b42f8885bb04679b7fca25fa9ac43b1
I20260810 04:51:17.467406 29201 ts_tablet_manager.cc:1939] T 9b42f8885bb04679b7fca25fa9ac43b1 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting consensus metadata
I20260810 04:51:17.467759 28305 catalog_manager.cc:4841] TS 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863): tablet 9b42f8885bb04679b7fca25fa9ac43b1 (table test-table [id=528c62b763834d73b13b0a25023cc98d]) successfully deleted
Aug 10 04:51:17 dist-test-slave-kvfs krb5kdc[28257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 04:51:17 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:17 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:51:17.492591 28400 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:17.486121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39604 (local address 127.15.239.254:41121)
0810 04:51:17.486204 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.486207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.486310 (+ 103us) server_negotiation.cc:407] Connection header received
0810 04:51:17.486376 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.486377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.486393 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.486465 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:17.487120 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.487994 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.488842 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.489156 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.489242 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.492507 (+ 3265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39604: BlockingRecv error: recv got EOF from 127.0.0.1:39604 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 04:51:17 dist-test-slave-kvfs krb5kdc[28257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM
I20260810 04:51:17.501456 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.493608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39606 (local address 127.15.239.254:41121)
0810 04:51:17.493657 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.493659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.493719 (+ 60us) server_negotiation.cc:407] Connection header received
0810 04:51:17.493799 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.493800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.493808 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.493856 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:17.494491 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.494975 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.495952 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.496246 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.496301 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.498739 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:17.498741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:17.498741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:17.498750 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:17.500267 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:17.500611 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:17.500613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:17.500613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:17.500679 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:17.500882 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:17.500883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:17.500884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:17.501013 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:17.501131 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.501236 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.501328 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:51:17.503404 28324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:17.503654 28324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:17.505429 28536 tablet_service.cc:1467] Processing CreateTablet for tablet 0231adda23f24d6d803e9e3153a58bb5 (DEFAULT_TABLE table=test-table [id=a479d375540149f78e6537b1c1bfcda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.505491 28766 tablet_service.cc:1467] Processing CreateTablet for tablet 0231adda23f24d6d803e9e3153a58bb5 (DEFAULT_TABLE table=test-table [id=a479d375540149f78e6537b1c1bfcda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.505640 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0231adda23f24d6d803e9e3153a58bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.505673 28766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0231adda23f24d6d803e9e3153a58bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.506870 29169 tablet_bootstrap.cc:492] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Bootstrap starting.
I20260810 04:51:17.506989 29001 tablet_service.cc:1467] Processing CreateTablet for tablet 0231adda23f24d6d803e9e3153a58bb5 (DEFAULT_TABLE table=test-table [id=a479d375540149f78e6537b1c1bfcda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.507140 29001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0231adda23f24d6d803e9e3153a58bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.507300 29169 tablet_bootstrap.cc:654] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.507377 29167 tablet_bootstrap.cc:492] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Bootstrap starting.
I20260810 04:51:17.507882 29167 tablet_bootstrap.cc:654] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.508728 29167 tablet_bootstrap.cc:492] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: No bootstrap required, opened a new log
I20260810 04:51:17.508714 29168 tablet_bootstrap.cc:492] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Bootstrap starting.
I20260810 04:51:17.508780 29167 ts_tablet_manager.cc:1397] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:17.508976 29167 raft_consensus.cc:348] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.509088 29167 raft_consensus.cc:374] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.509111 29167 raft_consensus.cc:729] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f55b3b4554a48bb81b4d344ecfe5223, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.509160 29167 consensus_queue.cc:260] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.509256 29169 tablet_bootstrap.cc:492] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: No bootstrap required, opened a new log
I20260810 04:51:17.509274 29168 tablet_bootstrap.cc:654] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.509294 29169 ts_tablet_manager.cc:1397] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:51:17.509301 29167 ts_tablet_manager.cc:1428] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 04:51:17.509424 29169 raft_consensus.cc:348] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.509509 29169 raft_consensus.cc:374] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.509531 29169 raft_consensus.cc:729] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.509582 29169 consensus_queue.cc:260] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.509686 29169 ts_tablet_manager.cc:1428] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.510406 29168 tablet_bootstrap.cc:492] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: No bootstrap required, opened a new log
I20260810 04:51:17.510465 29168 ts_tablet_manager.cc:1397] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:51:17.510648 29168 raft_consensus.cc:348] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.510723 29168 raft_consensus.cc:374] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.510737 29168 raft_consensus.cc:729] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.510802 29168 consensus_queue.cc:260] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.510905 29168 ts_tablet_manager.cc:1428] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.666432 29173 raft_consensus.cc:482] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:17.666615 29173 raft_consensus.cc:504] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.666893 29173 leader_election.cc:288] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.667227 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0231adda23f24d6d803e9e3153a58bb5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" is_pre_election: true
I20260810 04:51:17.667227 28568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0231adda23f24d6d803e9e3153a58bb5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9eac43a787840b5b2de26b958c9a8a5" is_pre_election: true
I20260810 04:51:17.667382 28801 raft_consensus.cc:2454] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 0.
I20260810 04:51:17.667378 28568 raft_consensus.cc:2454] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 0.
I20260810 04:51:17.667588 28920 leader_election.cc:302] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, 7894d6fd6f5d4e6fae719fe1f43bd813; no voters:
I20260810 04:51:17.667717 29173 raft_consensus.cc:2781] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:17.667761 29173 raft_consensus.cc:482] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:17.667791 29173 raft_consensus.cc:3037] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.668738 29173 raft_consensus.cc:504] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.668918 29173 leader_election.cc:288] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 election: Requested vote from peers a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.669175 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0231adda23f24d6d803e9e3153a58bb5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
I20260810 04:51:17.669165 28568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0231adda23f24d6d803e9e3153a58bb5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9eac43a787840b5b2de26b958c9a8a5"
I20260810 04:51:17.669283 28801 raft_consensus.cc:3037] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.669282 28568 raft_consensus.cc:3037] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.670101 28801 raft_consensus.cc:2454] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 1.
I20260810 04:51:17.670214 28568 raft_consensus.cc:2454] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 1.
I20260810 04:51:17.670362 28920 leader_election.cc:302] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, 7894d6fd6f5d4e6fae719fe1f43bd813; no voters:
I20260810 04:51:17.670464 29173 raft_consensus.cc:2781] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:17.670531 29173 raft_consensus.cc:686] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 LEADER]: Becoming Leader. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Running, Role: LEADER
I20260810 04:51:17.670593 29173 consensus_queue.cc:237] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.671360 28324 catalog_manager.cc:5495] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195). New cstate: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } health_report { overall_health: HEALTHY } } }
I20260810 04:51:17.697659 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.695117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.15.239.195:38863)
0810 04:51:17.695223 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.695225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.695236 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:17.695273 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.695274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.695287 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.695347 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:17.695474 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.696004 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.696843 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.697052 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.697124 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.697369 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.697407 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.697461 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.697547 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.697573 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 04:51:17.698956 28801 raft_consensus.cc:1261] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Refusing update from remote peer 7894d6fd6f5d4e6fae719fe1f43bd813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.698975 28568 raft_consensus.cc:1261] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7894d6fd6f5d4e6fae719fe1f43bd813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.699260 29227 consensus_queue.cc:1035] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.699424 29173 consensus_queue.cc:1035] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.703260 28324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.703382 28324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.704196 28324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Sending DeleteTablet for 3 replicas of tablet 0231adda23f24d6d803e9e3153a58bb5
I20260810 04:51:17.704535 28766 tablet_service.cc:1514] Processing DeleteTablet for tablet 0231adda23f24d6d803e9e3153a58bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59220
I20260810 04:51:17.704541 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet 0231adda23f24d6d803e9e3153a58bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:52080
I20260810 04:51:17.704656 29199 tablet_replica.cc:330] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: stopping tablet replica
I20260810 04:51:17.704658 29001 tablet_service.cc:1514] Processing DeleteTablet for tablet 0231adda23f24d6d803e9e3153a58bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:35624
I20260810 04:51:17.704722 29199 raft_consensus.cc:2229] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.704758 29198 tablet_replica.cc:330] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: stopping tablet replica
I20260810 04:51:17.704783 29199 raft_consensus.cc:2258] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.704772 29201 tablet_replica.cc:330] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: stopping tablet replica
I20260810 04:51:17.704818 29198 raft_consensus.cc:2229] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.704835 29201 raft_consensus.cc:2229] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:17.704871 29198 raft_consensus.cc:2258] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.704949 29201 raft_consensus.cc:2258] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.705205 28324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 04:51:17.705309 29201 ts_tablet_manager.cc:1905] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 04:51:17.705396 28324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:17.705441 29198 ts_tablet_manager.cc:1905] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.705783 29199 ts_tablet_manager.cc:1905] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.707595 29198 ts_tablet_manager.cc:1918] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:17.707662 29198 log.cc:1196] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/0231adda23f24d6d803e9e3153a58bb5
I20260810 04:51:17.707693 29199 ts_tablet_manager.cc:1918] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:17.707768 29199 log.cc:1196] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/0231adda23f24d6d803e9e3153a58bb5
I20260810 04:51:17.707911 29198 ts_tablet_manager.cc:1939] T 0231adda23f24d6d803e9e3153a58bb5 P a9eac43a787840b5b2de26b958c9a8a5: Deleting consensus metadata
I20260810 04:51:17.708051 29199 ts_tablet_manager.cc:1939] T 0231adda23f24d6d803e9e3153a58bb5 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting consensus metadata
I20260810 04:51:17.708473 28307 catalog_manager.cc:4841] TS 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743): tablet 0231adda23f24d6d803e9e3153a58bb5 (table test-table [id=a479d375540149f78e6537b1c1bfcda8]) successfully deleted
I20260810 04:51:17.708655 29001 tablet_service.cc:1467] Processing CreateTablet for tablet ffeaa658af9940df93f32d31e2ea94f5 (DEFAULT_TABLE table=test-table [id=c7bd2778c54f4e7485ee28bdb2da8c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.708673 28766 tablet_service.cc:1467] Processing CreateTablet for tablet ffeaa658af9940df93f32d31e2ea94f5 (DEFAULT_TABLE table=test-table [id=c7bd2778c54f4e7485ee28bdb2da8c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.708786 28766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffeaa658af9940df93f32d31e2ea94f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.708806 28536 tablet_service.cc:1467] Processing CreateTablet for tablet ffeaa658af9940df93f32d31e2ea94f5 (DEFAULT_TABLE table=test-table [id=c7bd2778c54f4e7485ee28bdb2da8c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:17.708909 28536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffeaa658af9940df93f32d31e2ea94f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.709642 29167 tablet_bootstrap.cc:492] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Bootstrap starting.
I20260810 04:51:17.709674 28306 catalog_manager.cc:4841] TS a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403): tablet 0231adda23f24d6d803e9e3153a58bb5 (table test-table [id=a479d375540149f78e6537b1c1bfcda8]) successfully deleted
I20260810 04:51:17.709836 29201 ts_tablet_manager.cc:1918] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:17.709898 29201 log.cc:1196] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/0231adda23f24d6d803e9e3153a58bb5
I20260810 04:51:17.710116 29167 tablet_bootstrap.cc:654] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.710136 29201 ts_tablet_manager.cc:1939] T 0231adda23f24d6d803e9e3153a58bb5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting consensus metadata
I20260810 04:51:17.710177 29169 tablet_bootstrap.cc:492] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5: Bootstrap starting.
I20260810 04:51:17.710546 29169 tablet_bootstrap.cc:654] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.710824 29001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffeaa658af9940df93f32d31e2ea94f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:17.711014 29167 tablet_bootstrap.cc:492] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: No bootstrap required, opened a new log
I20260810 04:51:17.711063 29167 ts_tablet_manager.cc:1397] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:17.711221 29167 raft_consensus.cc:348] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.711279 29167 raft_consensus.cc:374] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.711295 29167 raft_consensus.cc:729] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f55b3b4554a48bb81b4d344ecfe5223, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.711369 29167 consensus_queue.cc:260] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.711472 29167 ts_tablet_manager.cc:1428] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.712239 29168 tablet_bootstrap.cc:492] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Bootstrap starting.
I20260810 04:51:17.712590 29168 tablet_bootstrap.cc:654] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:17.713284 29168 tablet_bootstrap.cc:492] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: No bootstrap required, opened a new log
I20260810 04:51:17.713330 29168 ts_tablet_manager.cc:1397] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:17.713341 29169 tablet_bootstrap.cc:492] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5: No bootstrap required, opened a new log
I20260810 04:51:17.713389 29169 ts_tablet_manager.cc:1397] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 04:51:17.713433 29168 raft_consensus.cc:348] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.713492 29168 raft_consensus.cc:374] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.713505 29168 raft_consensus.cc:729] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.713526 29169 raft_consensus.cc:348] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.713567 29168 consensus_queue.cc:260] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.713596 29169 raft_consensus.cc:374] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:17.713615 29169 raft_consensus.cc:729] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9eac43a787840b5b2de26b958c9a8a5, State: Initialized, Role: FOLLOWER
I20260810 04:51:17.713660 29168 ts_tablet_manager.cc:1428] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.713661 29169 consensus_queue.cc:260] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.713749 29169 ts_tablet_manager.cc:1428] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:17.714327 28305 catalog_manager.cc:4841] TS 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863): tablet 0231adda23f24d6d803e9e3153a58bb5 (table test-table [id=a479d375540149f78e6537b1c1bfcda8]) successfully deleted
I20260810 04:51:17.857748 29173 raft_consensus.cc:482] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:17.857963 29173 raft_consensus.cc:504] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.858248 29173 leader_election.cc:288] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.858578 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeaa658af9940df93f32d31e2ea94f5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" is_pre_election: true
I20260810 04:51:17.858578 28568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeaa658af9940df93f32d31e2ea94f5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9eac43a787840b5b2de26b958c9a8a5" is_pre_election: true
I20260810 04:51:17.858728 28801 raft_consensus.cc:2454] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 0.
I20260810 04:51:17.858729 28568 raft_consensus.cc:2454] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 0.
I20260810 04:51:17.858968 28920 leader_election.cc:302] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, 7894d6fd6f5d4e6fae719fe1f43bd813; no voters:
I20260810 04:51:17.859122 29173 raft_consensus.cc:2781] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:17.859190 29173 raft_consensus.cc:482] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:17.859207 29173 raft_consensus.cc:3037] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.860288 29173 raft_consensus.cc:504] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.860548 29173 leader_election.cc:288] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 election: Requested vote from peers a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403), 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743)
I20260810 04:51:17.860661 28801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeaa658af9940df93f32d31e2ea94f5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f55b3b4554a48bb81b4d344ecfe5223"
I20260810 04:51:17.860664 28568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffeaa658af9940df93f32d31e2ea94f5" candidate_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9eac43a787840b5b2de26b958c9a8a5"
I20260810 04:51:17.860752 28801 raft_consensus.cc:3037] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.860757 28568 raft_consensus.cc:3037] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:17.861471 28801 raft_consensus.cc:2454] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 1.
I20260810 04:51:17.861689 28920 leader_election.cc:302] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f55b3b4554a48bb81b4d344ecfe5223, 7894d6fd6f5d4e6fae719fe1f43bd813; no voters:
I20260810 04:51:17.861737 28568 raft_consensus.cc:2454] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7894d6fd6f5d4e6fae719fe1f43bd813 in term 1.
I20260810 04:51:17.861923 29173 raft_consensus.cc:2781] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:17.862020 29173 raft_consensus.cc:686] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 LEADER]: Becoming Leader. State: Replica: 7894d6fd6f5d4e6fae719fe1f43bd813, State: Running, Role: LEADER
I20260810 04:51:17.862083 29173 consensus_queue.cc:237] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } }
I20260810 04:51:17.862891 28326 catalog_manager.cc:5495] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195). New cstate: current_term: 1 leader_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7894d6fd6f5d4e6fae719fe1f43bd813" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 38863 } health_report { overall_health: HEALTHY } } }
I20260810 04:51:17.903582 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.901267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:49729 (local address 127.15.239.195:38863)
0810 04:51:17.901324 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:17.901326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:17.901332 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:51:17.901350 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:17.901351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:17.901361 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:17.901425 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:17.901576 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.902093 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.902863 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.903078 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.903163 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.903281 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.903320 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.903372 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:17.903448 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 04:51:17.903474 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":33}
I20260810 04:51:17.903582 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.901073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:38863 (local address 127.15.239.195:49729)
0810 04:51:17.901141 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.901159 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:17.901204 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:17.901440 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:17.901442 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:17.901443 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 04:51:17.901512 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.901514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.902188 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.902189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.902778 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:17.902780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:17.903160 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:17.903161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:17.903215 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:17.903223 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 04:51:17.903386 (+ 163us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 04:51:17.903388 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:51:17.903444 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:51:17.903508 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":2}
I20260810 04:51:17.906168 28801 raft_consensus.cc:1261] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Refusing update from remote peer 7894d6fd6f5d4e6fae719fe1f43bd813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.906193 28568 raft_consensus.cc:1261] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Refusing update from remote peer 7894d6fd6f5d4e6fae719fe1f43bd813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:17.906435 29173 consensus_queue.cc:1035] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9eac43a787840b5b2de26b958c9a8a5" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 40403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.906579 29246 consensus_queue.cc:1035] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f55b3b4554a48bb81b4d344ecfe5223" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:17.916882 28324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.917043 28324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:17.917876 28324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2472f3ad3f29479684f2cea489e7141e: Sending DeleteTablet for 3 replicas of tablet ffeaa658af9940df93f32d31e2ea94f5
I20260810 04:51:17.918200 28999 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeaa658af9940df93f32d31e2ea94f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:35624
I20260810 04:51:17.918223 28766 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeaa658af9940df93f32d31e2ea94f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59220
I20260810 04:51:17.918229 28536 tablet_service.cc:1514] Processing DeleteTablet for tablet ffeaa658af9940df93f32d31e2ea94f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:17 UTC) from {username='oryx', principal='oryx/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:52080
I20260810 04:51:17.918325 29199 tablet_replica.cc:330] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: stopping tablet replica
I20260810 04:51:17.918363 29201 tablet_replica.cc:330] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: stopping tablet replica
I20260810 04:51:17.918406 29199 raft_consensus.cc:2229] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.918434 29201 raft_consensus.cc:2229] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:17.918445 29199 raft_consensus.cc:2258] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.918514 29201 raft_consensus.cc:2258] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.918602 29198 tablet_replica.cc:330] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5: stopping tablet replica
I20260810 04:51:17.918681 29198 raft_consensus.cc:2229] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:17.918725 29198 raft_consensus.cc:2258] T ffeaa658af9940df93f32d31e2ea94f5 P a9eac43a787840b5b2de26b958c9a8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:17.918903 29201 ts_tablet_manager.cc:1905] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.918922 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 28433
I20260810 04:51:17.925266 29201 ts_tablet_manager.cc:1918] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:51:17.925352 29201 log.cc:1196] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/ffeaa658af9940df93f32d31e2ea94f5
I20260810 04:51:17.925626 29201 ts_tablet_manager.cc:1939] T ffeaa658af9940df93f32d31e2ea94f5 P 7894d6fd6f5d4e6fae719fe1f43bd813: Deleting consensus metadata
I20260810 04:51:17.926069 28305 catalog_manager.cc:4841] TS 7894d6fd6f5d4e6fae719fe1f43bd813 (127.15.239.195:38863): tablet ffeaa658af9940df93f32d31e2ea94f5 (table test-table [id=c7bd2778c54f4e7485ee28bdb2da8c5f]) successfully deleted
I20260810 04:51:17.932497 29199 ts_tablet_manager.cc:1905] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:17.934165 29199 ts_tablet_manager.cc:1918] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 04:51:17.934254 29199 log.cc:1196] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/ffeaa658af9940df93f32d31e2ea94f5
I20260810 04:51:17.934517 29199 ts_tablet_manager.cc:1939] T ffeaa658af9940df93f32d31e2ea94f5 P 2f55b3b4554a48bb81b4d344ecfe5223: Deleting consensus metadata
I20260810 04:51:17.934970 28307 catalog_manager.cc:4841] TS 2f55b3b4554a48bb81b4d344ecfe5223 (127.15.239.194:42743): tablet ffeaa658af9940df93f32d31e2ea94f5 (table test-table [id=c7bd2778c54f4e7485ee28bdb2da8c5f]) successfully deleted
W20260810 04:51:17.939350 28306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:40403 (error 108)
I20260810 04:51:17.939740 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 28649
I20260810 04:51:17.956909 29298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:17.939822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:40403 (local address 127.0.0.1:52100)
0810 04:51:17.956691 (+ 16869us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:17.956829 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:40403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16834,"thread_start_us":63,"threads_started":1}
W20260810 04:51:17.957152 28306 catalog_manager.cc:4584] TS a9eac43a787840b5b2de26b958c9a8a5 (127.15.239.193:40403): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffeaa658af9940df93f32d31e2ea94f5: Network error: Client connection negotiation failed: client connection to 127.15.239.193:40403: connect: Connection refused (error 111)
I20260810 04:51:17.964109 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 28896
I20260810 04:51:17.979040 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 28277
2026-08-10T04:51:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3392 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:18 dist-test-slave-kvfs krb5kdc[29301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:18 dist-test-slave-kvfs krb5kdc[29301](info): set up 2 sockets
Aug 10 04:51:18 dist-test-slave-kvfs krb5kdc[29301](info): commencing operation
krb5kdc: starting...
W20260810 04:51:19.304215 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:19 dist-test-slave-kvfs krb5kdc[29301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:51:19.456285 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35709
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:35709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:19.555415 29320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:19.555761 29320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:19.555805 29320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:19.557286 29320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:19.557399 29320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:19.557425 29320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:19.557446 29320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:19.557464 29320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:19.559309 29320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:35709
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:19.559703 29320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:19.560060 29320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:19.566860 29330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:19.566843 29336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:19.566869 29320 server_base.cc:1034] running on GCE node
W20260810 04:51:19.566843 29329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:19.567554 29320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:19.567909 29320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:19.569128 29320 hybrid_clock.cc:648] HybridClock initialized: now 1786337479569141 us; error 64 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T04:51:19Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1594 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:19 dist-test-slave-kvfs krb5kdc[29345](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:19 dist-test-slave-kvfs krb5kdc[29345](info): set up 2 sockets
Aug 10 04:51:19 dist-test-slave-kvfs krb5kdc[29345](info): commencing operation
krb5kdc: starting...
W20260810 04:51:20.919556 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:51:21.075701 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42407
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:21.181242 29365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:21.181557 29365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:21.181599 29365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:21.182886 29365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:21.182962 29365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:21.182988 29365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:21.183009 29365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:21.183041 29365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:21.184796 29365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:21.185222 29365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:21.185578 29365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:21.191892 29372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.191936 29377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.191892 29373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:21.192272 29365 server_base.cc:1034] running on GCE node
I20260810 04:51:21.192654 29365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:21.193040 29365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:21.194232 29365 hybrid_clock.cc:648] HybridClock initialized: now 1786337481194204 us; error 48 us; skew 500 ppm
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:21.197547 29365 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:51:21.198056 29365 webserver.cc:460] Webserver started at http://127.15.239.254:39079/ using document root <none> and password file <none>
I20260810 04:51:21.198307 29365 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:21.198354 29365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:21.198459 29365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:21.199715 29365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "3f5d0a38a03b48e79c84bcc1993a09c6"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "3e49b4604e3c8dba5548b33823ce3250"
server_key_iv: "cf67bc593e7251e977796a556345d1df"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.200156 29365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "3f5d0a38a03b48e79c84bcc1993a09c6"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "3e49b4604e3c8dba5548b33823ce3250"
server_key_iv: "cf67bc593e7251e977796a556345d1df"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.202363 29365 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 04:51:21.203236 29386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.203483 29365 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:21.203599 29365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "3f5d0a38a03b48e79c84bcc1993a09c6"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "3e49b4604e3c8dba5548b33823ce3250"
server_key_iv: "cf67bc593e7251e977796a556345d1df"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.203666 29365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:21.237790 29365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:21.240773 29365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:21.240928 29365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:21.247601 29365 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:42407
I20260810 04:51:21.247794 29465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:42407 every 8 connection(s)
I20260810 04:51:21.248260 29365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:21.249794 29469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:21.253597 29469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Bootstrap starting.
I20260810 04:51:21.253738 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 29365
I20260810 04:51:21.253861 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:21.254144 16319 external_mini_cluster.cc:1428] Setting key 14639e4a6416a7907f62991209e4187a
I20260810 04:51:21.254506 29469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:21.254937 29469 log.cc:824] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:21.255852 29469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: No bootstrap required, opened a new log
I20260810 04:51:21.258019 29469 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:21.258212 29469 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:21.258273 29469 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f5d0a38a03b48e79c84bcc1993a09c6, State: Initialized, Role: FOLLOWER
I20260810 04:51:21.258445 29469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:21.258544 29469 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:21.258598 29469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:21.258651 29469 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:21.259305 29469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:21.259452 29469 leader_election.cc:302] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f5d0a38a03b48e79c84bcc1993a09c6; no voters:
I20260810 04:51:21.259660 29469 leader_election.cc:288] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:21.259727 29474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:21.259934 29474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 LEADER]: Becoming Leader. State: Replica: 3f5d0a38a03b48e79c84bcc1993a09c6, State: Running, Role: LEADER
I20260810 04:51:21.259997 29469 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:21.260236 29474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:21.260660 29475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f5d0a38a03b48e79c84bcc1993a09c6. Latest consensus state: current_term: 1 leader_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } } }
I20260810 04:51:21.260788 29475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:21.261004 29487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:21.261590 29487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:21.262017 29477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } } }
I20260810 04:51:21.262136 29477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: This master's current role is: LEADER
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:21.264158 29487 catalog_manager.cc:1347] Generated new cluster ID: 33c046d84aae4a1fa5db6cd602dc2eaa
I20260810 04:51:21.264214 29487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:21.266580 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.254791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.15.239.254:42407)
0810 04:51:21.255060 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:21.255073 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:21.255111 (+ 38us) server_negotiation.cc:407] Connection header received
0810 04:51:21.255744 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:21.255754 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:21.255817 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:21.256007 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:21.256760 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.257798 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.258908 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.259394 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.259544 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.262931 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:21.262936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:21.262936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:21.262953 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:21.264869 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.265311 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.265314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.265315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.265414 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.265650 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.265651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.265651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.265924 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:21.266086 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:21.266224 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 04:51:21.266381 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":126,"threads_started":1}
I20260810 04:51:21.271813 29487 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:21.272648 29487 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:21.277328 29487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Generated new TSK 0
I20260810 04:51:21.277544 29487 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:51:21.316465 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42407
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:21.415149 29506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:21.415418 29506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:21.415444 29506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:21.416626 29506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:21.416666 29506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:21.416692 29506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:21.418156 29506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:21.418381 29506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:21.418615 29506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:21.424517 29515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.424530 29513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:21.424585 29506 server_base.cc:1034] running on GCE node
W20260810 04:51:21.424551 29512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:21.424960 29506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:21.425277 29506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:21.426474 29506 hybrid_clock.cc:648] HybridClock initialized: now 1786337481426453 us; error 58 us; skew 500 ppm
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:21.429742 29506 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:51:21.430351 29506 webserver.cc:460] Webserver started at http://127.15.239.193:34521/ using document root <none> and password file <none>
I20260810 04:51:21.430635 29506 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:21.430716 29506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:21.430893 29506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:21.432255 29506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "174fc78468854291995b494f9dd82011"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "51758ff0efd0acb1aff9078fb179beb3"
server_key_iv: "1d7fb7c5947d1147e6174b32a1128a79"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.432682 29506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "174fc78468854291995b494f9dd82011"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "51758ff0efd0acb1aff9078fb179beb3"
server_key_iv: "1d7fb7c5947d1147e6174b32a1128a79"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.435597 29506 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 04:51:21.436553 29528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.436761 29506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:21.436913 29506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "174fc78468854291995b494f9dd82011"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "51758ff0efd0acb1aff9078fb179beb3"
server_key_iv: "1d7fb7c5947d1147e6174b32a1128a79"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.437008 29506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:21.460470 29506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:21.463445 29506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:21.463652 29506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:21.463980 29506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:21.464416 29506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:21.464483 29506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.464529 29506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:21.464550 29506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.471659 29506 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:45137
I20260810 04:51:21.471717 29718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:45137 every 8 connection(s)
I20260810 04:51:21.472218 29506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:21.474212 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 29506
I20260810 04:51:21.474378 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:21.474612 16319 external_mini_cluster.cc:1428] Setting key 7b5fa5dac5fa869b85d32da59b539499
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:21.484789 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.473199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:56217 (local address 127.15.239.254:42407)
0810 04:51:21.473280 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:21.473284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:21.473559 (+ 275us) server_negotiation.cc:407] Connection header received
0810 04:51:21.474328 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:21.474329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:21.474346 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:21.474408 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:21.476049 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.476665 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.477986 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.478275 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.478346 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.481405 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:21.481407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:21.481408 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:21.481418 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:21.483077 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.483579 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.483580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.483580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.483653 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.483960 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.483961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.483961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.484159 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:21.484252 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:21.484572 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 04:51:21.484680 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:51:21.485029 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.473153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:56217)
0810 04:51:21.473365 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:21.473425 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:21.474160 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:21.474528 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:21.474532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:21.475562 (+ 1030us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:21.475906 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:21.475913 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.476820 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.476822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:21.477861 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:21.477865 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.478392 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.478393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:21.478572 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.479282 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:21.479298 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:21.481278 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:21.483200 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:21.483209 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:21.483212 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:21.483471 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:21.483732 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:21.483733 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:21.483734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:21.483871 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:21.484238 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:21.484247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:21.484418 (+ 171us) client_negotiation.cc:769] Sending connection context
0810 04:51:21.484547 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 04:51:21.484732 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
I20260810 04:51:21.485646 29720 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42407
I20260810 04:51:21.485785 29720 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:21.486045 29720 heartbeater.cc:511] Master 127.15.239.254:42407 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
I20260810 04:51:21.486840 29411 ts_manager.cc:194] Registered new tserver with Master: 174fc78468854291995b494f9dd82011 (127.15.239.193:45137)
I20260810 04:51:21.487573 29411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:56217
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:51:21.512300 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42407
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:21.609884 29731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:21.610157 29731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:21.610198 29731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:21.611433 29731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:21.611509 29731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:21.611557 29731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:21.613180 29731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:21.613488 29731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:21.613770 29731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:21.619733 29739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.619828 29745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.619660 29741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:21.620000 29731 server_base.cc:1034] running on GCE node
I20260810 04:51:21.620345 29731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:21.620657 29731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:21.621878 29731 hybrid_clock.cc:648] HybridClock initialized: now 1786337481621853 us; error 35 us; skew 500 ppm
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:21.625124 29731 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:51:21.625696 29731 webserver.cc:460] Webserver started at http://127.15.239.194:33565/ using document root <none> and password file <none>
I20260810 04:51:21.626003 29731 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:21.626086 29731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:21.626253 29731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:21.627453 29731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "92c352b7b3bb4b9695ffdc160b66f7c0"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "31be5fbf92ebd00aa572c16780f7be95"
server_key_iv: "9251241fb5c109d58a91d79526c5c84b"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.627895 29731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "92c352b7b3bb4b9695ffdc160b66f7c0"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "31be5fbf92ebd00aa572c16780f7be95"
server_key_iv: "9251241fb5c109d58a91d79526c5c84b"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.629528 29731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:21.630398 29758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.630692 29731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:21.630803 29731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "92c352b7b3bb4b9695ffdc160b66f7c0"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "31be5fbf92ebd00aa572c16780f7be95"
server_key_iv: "9251241fb5c109d58a91d79526c5c84b"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.630872 29731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:21.645457 29731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:21.648316 29731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:21.648454 29731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:21.648686 29731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:21.649106 29731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:21.649175 29731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.649214 29731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:21.649245 29731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.655933 29731 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:41799
I20260810 04:51:21.656090 29920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:41799 every 8 connection(s)
I20260810 04:51:21.656476 29731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:21.660183 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 29731
I20260810 04:51:21.660331 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:21.660642 16319 external_mini_cluster.cc:1428] Setting key 1b947595b8c1fa208f58eb4daadd94bf
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:21.669039 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.657404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:44709 (local address 127.15.239.254:42407)
0810 04:51:21.657495 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:21.657498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:21.657747 (+ 249us) server_negotiation.cc:407] Connection header received
0810 04:51:21.658371 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:21.658373 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:21.658391 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:21.658476 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:21.659635 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.660438 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.662150 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.662351 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.662413 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.665623 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:21.665625 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:21.665626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:21.665635 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:21.667276 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.667876 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.667877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.667878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.667946 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.668267 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.668268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.668268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.668416 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:21.668506 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:21.668818 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 04:51:21.668920 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:51:21.669288 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.657380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:44709)
0810 04:51:21.657600 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:21.657645 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:21.658265 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:21.658563 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:21.658568 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:21.659251 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:21.659493 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:21.659498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.660572 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.660573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:21.662061 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:21.662065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.662449 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.662450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:21.662637 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.663272 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:21.663286 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:21.665494 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:21.667436 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:21.667450 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:21.667453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:21.667784 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:21.668048 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:21.668049 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:21.668049 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:21.668178 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:21.668493 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:21.668501 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:21.668667 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 04:51:21.668797 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 04:51:21.669003 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":121,"threads_started":1}
I20260810 04:51:21.669919 29921 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42407
I20260810 04:51:21.670066 29921 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:21.670303 29921 heartbeater.cc:511] Master 127.15.239.254:42407 requested a full tablet report, sending...
I20260810 04:51:21.670848 29411 ts_manager.cc:194] Registered new tserver with Master: 92c352b7b3bb4b9695ffdc160b66f7c0 (127.15.239.194:41799)
I20260810 04:51:21.671464 29411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:44709
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:51:21.696233 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42407
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:21.795442 29930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:21.795702 29930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:21.795729 29930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:21.797055 29930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:21.797104 29930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:21.797132 29930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:21.798622 29930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:21.798903 29930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:21.799168 29930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:21.805028 29940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.805020 29942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:21.805025 29939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:21.805442 29930 server_base.cc:1034] running on GCE node
I20260810 04:51:21.805708 29930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:21.805959 29930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:21.807124 29930 hybrid_clock.cc:648] HybridClock initialized: now 1786337481807108 us; error 33 us; skew 500 ppm
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:21.810289 29930 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:51:21.810847 29930 webserver.cc:460] Webserver started at http://127.15.239.195:37981/ using document root <none> and password file <none>
I20260810 04:51:21.811136 29930 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:21.811218 29930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:21.811390 29930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:21.812731 29930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "16f94a6a65cc4f1d979f6cd0743370dd"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "33f8e6cdb42311b0df6a458cdce2cf18"
server_key_iv: "891847e070f8c85a0aa8dda93ba21718"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.813164 29930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "16f94a6a65cc4f1d979f6cd0743370dd"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "33f8e6cdb42311b0df6a458cdce2cf18"
server_key_iv: "891847e070f8c85a0aa8dda93ba21718"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.814707 29930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:21.815680 29951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.815969 29930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:21.816148 29930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "16f94a6a65cc4f1d979f6cd0743370dd"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "33f8e6cdb42311b0df6a458cdce2cf18"
server_key_iv: "891847e070f8c85a0aa8dda93ba21718"
server_key_version: "encryptionkey@0"
I20260810 04:51:21.816237 29930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:21.833439 29930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:21.836277 29930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:21.836452 29930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:21.836771 29930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:21.837201 29930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:21.837249 29930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.837276 29930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:21.837325 29930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:21.844765 29930 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:45683
I20260810 04:51:21.844828 30121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:45683 every 8 connection(s)
I20260810 04:51:21.845275 29930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:51:21 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337481, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:21.853677 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 29930
I20260810 04:51:21.853869 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:21.854110 16319 external_mini_cluster.cc:1428] Setting key 19d2cce79e093b9af5406fa6f6c8e532
I20260810 04:51:21.856976 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.846281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:52873 (local address 127.15.239.254:42407)
0810 04:51:21.846389 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:21.846392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:21.846595 (+ 203us) server_negotiation.cc:407] Connection header received
0810 04:51:21.847193 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:21.847195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:21.847208 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:21.847268 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:21.848511 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.849093 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.850213 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.850453 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.850526 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.853351 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:21.853353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:21.853354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:21.853363 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:21.855290 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.855794 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.855795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.855795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.855885 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:21.856240 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:21.856241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:21.856241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:21.856395 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:21.856467 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:21.856805 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 04:51:21.856895 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 04:51:21.857143 30124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:21.846218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:52873)
0810 04:51:21.846426 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:21.846482 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:21.847066 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:21.847334 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:21.847338 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:21.848123 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:21.848383 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:21.848390 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.849191 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.849192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:21.850094 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:21.850097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:21.850568 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:21.850570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:21.850706 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:21.851413 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:21.851424 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:21.853227 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:21.855403 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:21.855412 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:21.855415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:21.855697 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:21.855965 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:21.855966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:21.855967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:21.856147 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:21.856471 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:21.856477 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:21.856627 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 04:51:21.856720 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 04:51:21.856884 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":135,"threads_started":1}
I20260810 04:51:21.857759 30122 heartbeater.cc:347] Connected to a master server at 127.15.239.254:42407
I20260810 04:51:21.857920 30122 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:21.858147 30122 heartbeater.cc:511] Master 127.15.239.254:42407 requested a full tablet report, sending...
I20260810 04:51:21.858690 29411 ts_manager.cc:194] Registered new tserver with Master: 16f94a6a65cc4f1d979f6cd0743370dd (127.15.239.195:45683)
I20260810 04:51:21.859182 29411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:52873
I20260810 04:51:21.866644 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab.
Entry for principal oryx/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab.
WARNING: no policy specified for oryx/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab.
Entry for principal oryx/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab.
WARNING: no policy specified for oryx/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab.
Entry for principal oryx/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab.
I20260810 04:51:21.968578 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 29506
I20260810 04:51:21.994103 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 29731
I20260810 04:51:22.006842 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 29930
I20260810 04:51:22.021173 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 29365
I20260810 04:51:22.036412 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42407
--webserver_interface=127.15.239.254
--webserver_port=39079
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:22.135795 30134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:22.136135 30134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:22.136178 30134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:22.137419 30134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:22.137502 30134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:22.137526 30134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:22.137547 30134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:22.137574 30134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:22.139215 30134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=39079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:22.139565 30134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:22.139859 30134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:51:22.146224 30134 server_base.cc:1034] running on GCE node
W20260810 04:51:22.146205 30143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.146205 30141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.146194 30140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:22.146733 30134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:22.147120 30134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:22.148300 30134 hybrid_clock.cc:648] HybridClock initialized: now 1786337482148290 us; error 64 us; skew 500 ppm
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337482, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:22.151357 30134 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:51:22.151958 30134 webserver.cc:460] Webserver started at http://127.15.239.254:39079/ using document root <none> and password file <none>
I20260810 04:51:22.152312 30134 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:22.152421 30134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:22.154150 30134 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:22.154987 30159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.155210 30134 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:22.155336 30134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "3f5d0a38a03b48e79c84bcc1993a09c6"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "3e49b4604e3c8dba5548b33823ce3250"
server_key_iv: "cf67bc593e7251e977796a556345d1df"
server_key_version: "encryptionkey@0"
I20260810 04:51:22.155807 30134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:22.179729 30134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:22.182683 30134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:22.182965 30134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:22.188529 30134 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:42407
I20260810 04:51:22.188634 30244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:42407 every 8 connection(s)
I20260810 04:51:22.189127 30134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:22.191058 30245 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:51:22.191881 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Bootstrap starting.
I20260810 04:51:22.194128 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 30134
I20260810 04:51:22.194505 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:45137
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:42407
--webserver_port=34521
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:51:22.203336 30245 log.cc:824] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:22.206084 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:51:22.206497 30245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Bootstrap complete.
I20260810 04:51:22.209604 30245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:22.210100 30245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f5d0a38a03b48e79c84bcc1993a09c6, State: Initialized, Role: FOLLOWER
I20260810 04:51:22.210381 30245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:22.210469 30245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:22.210525 30245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:22.210580 30245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:51:22.212602 30245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:22.212761 30245 leader_election.cc:302] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f5d0a38a03b48e79c84bcc1993a09c6; no voters:
I20260810 04:51:22.213027 30245 leader_election.cc:288] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:51:22.213228 30249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:51:22.213456 30245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:22.213642 30249 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [term 2 LEADER]: Becoming Leader. State: Replica: 3f5d0a38a03b48e79c84bcc1993a09c6, State: Running, Role: LEADER
I20260810 04:51:22.213899 30249 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } }
I20260810 04:51:22.214949 30250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } } }
I20260810 04:51:22.215063 30250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:22.215168 30251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f5d0a38a03b48e79c84bcc1993a09c6. Latest consensus state: current_term: 2 leader_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f5d0a38a03b48e79c84bcc1993a09c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42407 } } }
I20260810 04:51:22.215216 30251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:22.215607 30267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:22.216277 30267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:22.216436 30267 catalog_manager.cc:1259] Loaded cluster ID: 33c046d84aae4a1fa5db6cd602dc2eaa
I20260810 04:51:22.216475 30267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:22.217830 30267 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:22.218060 30267 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3f5d0a38a03b48e79c84bcc1993a09c6: Loaded TSK: 0
I20260810 04:51:22.218302 30267 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:51:22.296980 30247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:22.297279 30247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:22.297308 30247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:22.298717 30247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:22.298777 30247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:22.298808 30247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:22.300591 30247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.193.keytab
--principal=oryx/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:45137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=34521
--tserver_master_addrs=127.15.239.254:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:22.300938 30247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:22.301257 30247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:22.307458 30281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.307451 30286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.307582 30283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:22.307747 30247 server_base.cc:1034] running on GCE node
I20260810 04:51:22.308090 30247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:22.308425 30247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:22.309660 30247 hybrid_clock.cc:648] HybridClock initialized: now 1786337482309628 us; error 52 us; skew 500 ppm
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337482, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:22.312933 30247 init.cc:377] Logged in from keytab as oryx/127.15.239.193@KRBTEST.COM (short username oryx)
I20260810 04:51:22.313724 30247 webserver.cc:460] Webserver started at http://127.15.239.193:34521/ using document root <none> and password file <none>
I20260810 04:51:22.314073 30247 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:22.314154 30247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:22.316125 30247 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:22.316912 30299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.317221 30247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:22.317351 30247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "174fc78468854291995b494f9dd82011"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "51758ff0efd0acb1aff9078fb179beb3"
server_key_iv: "1d7fb7c5947d1147e6174b32a1128a79"
server_key_version: "encryptionkey@0"
I20260810 04:51:22.317837 30247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:22.330626 30247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:22.333282 30247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:22.333487 30247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:22.333779 30247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:22.334168 30247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:22.334230 30247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.334275 30247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:22.334296 30247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.341822 30247 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:45137
I20260810 04:51:22.341922 30482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:45137 every 8 connection(s)
I20260810 04:51:22.342355 30247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:22.342754 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 30247
I20260810 04:51:22.343130 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:41799
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:42407
--webserver_port=33565
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.353413 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.343413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:53513)
0810 04:51:22.343629 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.343680 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.344585 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.345133 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.345137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.345989 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.346326 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.346332 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.348109 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.348110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.348986 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.348989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.349688 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.349689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.349830 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.350511 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.350522 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.353148 (+ 2626us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":125,"threads_started":1}
W20260810 04:51:22.353513 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.344238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:53513 (local address 127.15.239.254:42407)
0810 04:51:22.344486 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.344498 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.344549 (+ 51us) server_negotiation.cc:407] Connection header received
0810 04:51:22.344828 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.344834 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.344886 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.345091 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.346486 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.347916 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.349106 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.349573 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.349717 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.353320 (+ 3603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:53513: BlockingRecv error: recv got EOF from 127.15.239.193:53513 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":100,"threads_started":1}
W20260810 04:51:22.354229 30483 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:42407 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.239.254:42407: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.359474 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.354545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:58809)
0810 04:51:22.354581 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.354594 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.354642 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.354781 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.354782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.354925 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.354980 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.354981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.355691 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.355692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.356304 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.356307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.356723 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.356724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.356801 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.357338 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.357345 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.359366 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":15}
W20260810 04:51:22.359532 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.354613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:58809 (local address 127.15.239.254:42407)
0810 04:51:22.354654 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.354656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.354667 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:22.354696 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.354697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.354711 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.354764 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.355078 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.355601 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.356409 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.356630 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.356722 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.359459 (+ 2737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:58809: BlockingRecv error: recv got EOF from 127.15.239.193:58809 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.364727 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.360097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:53283)
0810 04:51:22.360146 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.360157 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.360217 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.360398 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.360399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.360591 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.360635 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.360637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.361306 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.361307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.361829 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.361830 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.362231 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.362232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.362290 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.362794 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.362800 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.364629 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:51:22.364777 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.360142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:53283 (local address 127.15.239.254:42407)
0810 04:51:22.360179 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.360181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.360189 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:51:22.360315 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.360316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.360327 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.360374 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.360725 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.361216 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.361922 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.362139 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.362230 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.364706 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:53283: BlockingRecv error: recv got EOF from 127.15.239.193:53283 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 04:51:22.365142 30483 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:51:22.450337 30488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:22.450604 30488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:22.450630 30488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:22.451831 30488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:22.451867 30488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:22.451893 30488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:22.453466 30488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.194.keytab
--principal=oryx/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:41799
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=33565
--tserver_master_addrs=127.15.239.254:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:22.453724 30488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:22.453960 30488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:51:22.460191 30488 server_base.cc:1034] running on GCE node
W20260810 04:51:22.460215 30496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.460166 30498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.460376 30495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:22.460631 30488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:22.460942 30488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:22.462121 30488 hybrid_clock.cc:648] HybridClock initialized: now 1786337482462105 us; error 35 us; skew 500 ppm
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337482, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:22.465356 30488 init.cc:377] Logged in from keytab as oryx/127.15.239.194@KRBTEST.COM (short username oryx)
I20260810 04:51:22.465956 30488 webserver.cc:460] Webserver started at http://127.15.239.194:33565/ using document root <none> and password file <none>
I20260810 04:51:22.466276 30488 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:22.466374 30488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:22.468106 30488 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:22.468883 30509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.469233 30488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:22.469362 30488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "92c352b7b3bb4b9695ffdc160b66f7c0"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "31be5fbf92ebd00aa572c16780f7be95"
server_key_iv: "9251241fb5c109d58a91d79526c5c84b"
server_key_version: "encryptionkey@0"
I20260810 04:51:22.469801 30488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:22.486418 30488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:22.489066 30488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:22.489244 30488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:22.489569 30488 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:22.489991 30488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:22.490057 30488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.490105 30488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:22.490131 30488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.497345 30488 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:41799
I20260810 04:51:22.497399 30683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:41799 every 8 connection(s)
I20260810 04:51:22.497843 30488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:22.503238 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 30488
I20260810 04:51:22.503618 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:45683
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:42407
--webserver_port=37981
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:51:22.507071 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.498848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:54105 (local address 127.15.239.254:42407)
0810 04:51:22.498936 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.498939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.499213 (+ 274us) server_negotiation.cc:407] Connection header received
0810 04:51:22.499795 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.499796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.499813 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.499871 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.500958 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.501568 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.502676 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.502878 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.502939 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.507013 (+ 4074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:54105: BlockingRecv error: recv got EOF from 127.15.239.194:54105 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:51:22.507449 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.498838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:54105)
0810 04:51:22.499062 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.499107 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.499687 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.499944 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.499948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.500622 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.500862 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.500868 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.501670 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.501671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.502581 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.502583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.502983 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.502984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.503159 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.503865 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.503880 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.506885 (+ 3005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":127,"threads_started":1}
W20260810 04:51:22.507759 30684 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:42407 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.239.254:42407: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.513166 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.508046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:33787)
0810 04:51:22.508098 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.508110 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.508158 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.508352 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.508352 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.508475 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.508524 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.508526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.509419 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.509420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.509919 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.509921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.510444 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.510445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.510505 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.511012 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.511017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.513111 (+ 2094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 04:51:22.513336 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.508119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:33787 (local address 127.15.239.254:42407)
0810 04:51:22.508207 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.508210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.508219 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:51:22.508266 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.508267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.508279 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.508338 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.508601 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.509317 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.510032 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.510360 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.510439 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.513242 (+ 2803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:33787: BlockingRecv error: recv got EOF from 127.15.239.194:33787 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.518502 30686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.513447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:54891)
0810 04:51:22.513606 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.513617 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.513659 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.513828 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.513829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.514015 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.514051 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.514052 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.515054 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.515059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.515535 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.515536 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.516067 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.516069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.516115 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.516590 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.516596 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.518450 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
W20260810 04:51:22.518738 30684 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:51:22.518790 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.513642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:54891 (local address 127.15.239.254:42407)
0810 04:51:22.513682 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.513684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.513696 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:22.513722 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.513723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.513733 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.513798 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.514132 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.514957 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.515622 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.515938 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.516036 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.518574 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:54891: BlockingRecv error: recv got EOF from 127.15.239.194:54891 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:51:22.606686 30688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:22.606963 30688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:22.606990 30688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:22.608220 30688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:22.608266 30688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:22.608295 30688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:22.609788 30688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/krb5kdc/oryx_127.15.239.195.keytab
--principal=oryx/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:45683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=37981
--tserver_master_addrs=127.15.239.254:42407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:22.610044 30688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:22.610275 30688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:22.616539 30713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.616586 30707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:22.616596 30704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:22.616843 30688 server_base.cc:1034] running on GCE node
I20260810 04:51:22.617125 30688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:22.617425 30688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:22.618609 30688 hybrid_clock.cc:648] HybridClock initialized: now 1786337482618600 us; error 41 us; skew 500 ppm
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337482, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:22.621846 30688 init.cc:377] Logged in from keytab as oryx/127.15.239.195@KRBTEST.COM (short username oryx)
I20260810 04:51:22.622412 30688 webserver.cc:460] Webserver started at http://127.15.239.195:37981/ using document root <none> and password file <none>
I20260810 04:51:22.622689 30688 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:22.622773 30688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:22.624390 30688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:51:22.625066 30726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.625277 30688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:22.625401 30688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "16f94a6a65cc4f1d979f6cd0743370dd"
format_stamp: "Formatted at 2026-08-10 04:51:21 on dist-test-slave-kvfs"
server_key: "33f8e6cdb42311b0df6a458cdce2cf18"
server_key_iv: "891847e070f8c85a0aa8dda93ba21718"
server_key_version: "encryptionkey@0"
I20260810 04:51:22.625823 30688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:22.636878 30688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:22.639480 30688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:22.639698 30688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:22.640141 30688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:22.640589 30688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:22.640631 30688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.640661 30688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:22.640715 30688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:22.648450 30688 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:45683
I20260810 04:51:22.648499 30890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:45683 every 8 connection(s)
I20260810 04:51:22.648962 30688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:22.652839 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 30688
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 04:51:22.658985 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.649964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:50641 (local address 127.15.239.254:42407)
0810 04:51:22.650050 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.650052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.650302 (+ 250us) server_negotiation.cc:407] Connection header received
0810 04:51:22.650965 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.650968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.650984 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.651048 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.652271 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.653032 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.654582 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.654787 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.654841 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.658914 (+ 4073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:50641: BlockingRecv error: recv got EOF from 127.15.239.195:50641 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:51:22.659101 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.649878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:50641)
0810 04:51:22.650136 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.650178 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.650821 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.651164 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.651168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.651835 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.652159 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.652165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.653153 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.653155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.654454 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.654458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.654896 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.654897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.655070 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.655769 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.655781 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.658852 (+ 3071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":85,"threads_started":1}
W20260810 04:51:22.659562 30891 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:42407 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.239.254:42407: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
I20260810 04:51:22.662266 30900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.653559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46038 (local address 127.15.239.254:42407)
0810 04:51:22.653737 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.653740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.653751 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:22.653787 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.653788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.653802 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.653896 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.654573 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.655404 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.656450 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.656752 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.656870 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.658360 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:22.658365 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:22.658366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:22.658383 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:22.660658 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:22.661091 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:22.661095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:22.661096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:22.661217 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:22.661450 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:22.661451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:22.661452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:22.661716 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:22.661884 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:22.662013 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 04:51:22.662139 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":85,"threads_started":1}
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.664381 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.659864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:59687)
0810 04:51:22.659898 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.659909 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.659958 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.660098 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.660099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.660234 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.660278 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.660280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.660917 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.660918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.661423 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.661425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.661800 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.661801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.661878 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.662307 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.662314 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.664297 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260810 04:51:22.664425 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.659939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:59687 (local address 127.15.239.254:42407)
0810 04:51:22.659981 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.659983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.660003 (+ 20us) server_negotiation.cc:407] Connection header received
0810 04:51:22.660041 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.660041 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.660050 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.660096 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.660363 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.660826 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.661528 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.661721 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.661802 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.664365 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:59687: BlockingRecv error: recv got EOF from 127.15.239.195:59687 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:22 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:22.668929 30895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:22.664651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:38637)
0810 04:51:22.664823 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:22.664832 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:22.664876 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:22.664999 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:22.665000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:22.665126 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:22.665152 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.665153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.665769 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.665770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.666290 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:22.666292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.666675 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.666676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:22.666731 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.667152 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:22.667157 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:22.668836 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":124,"threads_started":1}
W20260810 04:51:22.668948 30486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:22.664720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:38637 (local address 127.15.239.254:42407)
0810 04:51:22.664784 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:22.664786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:22.664886 (+ 100us) server_negotiation.cc:407] Connection header received
0810 04:51:22.664929 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:22.664930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:22.664939 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:22.664994 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:22.665239 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.665685 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.666391 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:22.666585 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:22.666673 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:22.668900 (+ 2227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:38637: BlockingRecv error: recv got EOF from 127.15.239.195:38637 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 04:51:22.669066 30891 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 04:51:23 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:23 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:23.371603 30902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:23.365726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:57239)
0810 04:51:23.365920 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:23.365931 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:23.366005 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:23.366347 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:23.366349 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:23.366665 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:23.366763 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:23.366766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.367590 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.367591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:23.368244 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:23.368245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.368647 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.368648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:23.368694 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:23.369312 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:23.369318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:23.371509 (+ 2191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":113,"threads_started":1}
W20260810 04:51:23.371856 30903 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:23.365830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:57239 (local address 127.15.239.254:42407)
0810 04:51:23.366067 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:23.366071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:23.366082 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:23.366120 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:23.366121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:23.366170 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:23.366281 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:23.366861 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.367509 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.368328 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.368569 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.368632 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:23.371640 (+ 3008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:57239: BlockingRecv error: recv got EOF from 127.15.239.193:57239 (error 108)
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":137,"threads_started":1}
Aug 10 04:51:23 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:23 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:23.525480 30904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:23.519281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:36733)
0810 04:51:23.519462 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:23.519477 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:23.519561 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:23.519783 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:23.519784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:23.519999 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:23.520091 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:23.520093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.520992 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.520994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:23.521838 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:23.521842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.522318 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.522320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:23.522364 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:23.522996 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:23.523002 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:23.525336 (+ 2334us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
W20260810 04:51:23.525528 30903 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:23.519439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:36733 (local address 127.15.239.254:42407)
0810 04:51:23.519530 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:23.519532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:23.519547 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:51:23.519651 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:23.519652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:23.519688 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:23.519764 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:23.520216 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.520818 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.521917 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.522244 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.522306 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:23.525450 (+ 3144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:36733: BlockingRecv error: recv got EOF from 127.15.239.194:36733 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 10 04:51:23 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:23 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:23.675566 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:23.669496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:44583)
0810 04:51:23.669732 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:23.669745 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:23.669856 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:23.670051 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:23.670052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:23.670295 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:23.670364 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:23.670367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.671154 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.671156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:23.671781 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:23.671783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.672287 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.672289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:23.672360 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:23.673039 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:23.673044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:23.675460 (+ 2416us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":114,"threads_started":1}
W20260810 04:51:23.675697 30903 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:23.669612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:44583 (local address 127.15.239.254:42407)
0810 04:51:23.669720 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:23.669723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:23.669830 (+ 107us) server_negotiation.cc:407] Connection header received
0810 04:51:23.669937 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:23.669938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:23.669958 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:23.670041 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:23.670457 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.671052 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.671894 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:23.672177 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:23.672287 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:23.675581 (+ 3294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:44583: BlockingRecv error: recv got EOF from 127.15.239.195:44583 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 10 04:51:24 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:24 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:24.378795 30907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:24.372471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:52687)
0810 04:51:24.372664 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:24.372680 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:24.372779 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:24.372980 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:24.372981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:24.373280 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:24.373355 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:24.373358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.374236 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.374237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:24.374813 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:24.374814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.375247 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.375248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:24.375302 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:24.375936 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:24.375942 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:24.378639 (+ 2697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":86,"threads_started":1}
W20260810 04:51:24.378845 30908 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:24.372592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:52687 (local address 127.15.239.254:42407)
0810 04:51:24.372765 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:24.372767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:24.372779 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:24.372858 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:24.372859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:24.372873 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:24.372936 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:24.373484 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.374082 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.374926 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.375157 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.375224 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:24.378754 (+ 3530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:52687: BlockingRecv error: recv got EOF from 127.15.239.193:52687 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
Aug 10 04:51:24 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:24 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:24.532439 30909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:24.526216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:53489)
0810 04:51:24.526415 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:24.526427 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:24.526506 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:24.526671 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:24.526671 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:24.526901 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:24.526987 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:24.526989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.527925 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.527927 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:24.528743 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:24.528748 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.529220 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.529221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:24.529271 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:24.529881 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:24.529887 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:24.532359 (+ 2472us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":118,"threads_started":1}
W20260810 04:51:24.532641 30908 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:24.526342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:53489 (local address 127.15.239.254:42407)
0810 04:51:24.526441 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:24.526443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:24.526501 (+ 58us) server_negotiation.cc:407] Connection header received
0810 04:51:24.526563 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:24.526563 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:24.526576 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:24.526646 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:24.527113 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.527847 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.528904 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.529131 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.529207 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:24.532553 (+ 3346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:53489: BlockingRecv error: recv got EOF from 127.15.239.194:53489 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 04:51:24 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:24 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:24.686116 30910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:24.676164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:47645)
0810 04:51:24.676367 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:24.676384 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:24.676487 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:24.676680 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:24.676681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:24.676919 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:24.676990 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:24.676993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.677817 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.677819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:24.678398 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:24.678400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.678837 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.678838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:24.678914 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:24.683575 (+ 4661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:24.683581 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:24.686037 (+ 2456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":107,"threads_started":1}
W20260810 04:51:24.686276 30908 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:24.676323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:47645 (local address 127.15.239.254:42407)
0810 04:51:24.676407 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:24.676409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:24.676442 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:51:24.676564 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:24.676565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:24.676584 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:24.676667 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:24.677110 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.677715 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.678523 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:24.678740 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:24.678824 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:24.686189 (+ 7365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:47645: BlockingRecv error: recv got EOF from 127.15.239.195:47645 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 04:51:25 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:25 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:25.385392 30911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:25.379636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:57753)
0810 04:51:25.379882 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:25.379895 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:25.379967 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:25.380168 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:25.380169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:25.380429 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:25.380517 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:25.380519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.381315 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.381316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:25.381954 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:25.381956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.382352 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.382353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:25.382408 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:25.383010 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:25.383015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:25.385310 (+ 2295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":167,"threads_started":1}
W20260810 04:51:25.385593 30912 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:25.379779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:57753 (local address 127.15.239.254:42407)
0810 04:51:25.379964 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:25.379967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:25.380008 (+ 41us) server_negotiation.cc:407] Connection header received
0810 04:51:25.380063 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:25.380064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:25.380077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:25.380135 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:25.380614 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.381232 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.382053 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.382268 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.382331 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:25.385467 (+ 3136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:57753: BlockingRecv error: recv got EOF from 127.15.239.193:57753 (error 108)
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
Aug 10 04:51:25 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:25 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:25.538769 30914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:25.533197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:50067)
0810 04:51:25.533372 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:25.533388 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:25.533498 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:25.533682 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:25.533683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:25.533922 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:25.533995 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:25.533997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.534788 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.534789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:25.535355 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:25.535357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.535784 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.535785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:25.535858 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:25.536527 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:25.536533 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:25.538643 (+ 2110us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
W20260810 04:51:25.538830 30912 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:25.533251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:50067 (local address 127.15.239.254:42407)
0810 04:51:25.533420 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:25.533422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:25.533450 (+ 28us) server_negotiation.cc:407] Connection header received
0810 04:51:25.533585 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:25.533586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:25.533603 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:25.533653 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:25.534084 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.534679 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.535447 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.535690 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.535775 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:25.538754 (+ 2979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:50067: BlockingRecv error: recv got EOF from 127.15.239.194:50067 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 10 04:51:25 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:25 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:25.693220 30916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:25.686834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:55073)
0810 04:51:25.687067 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:25.687086 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:25.687183 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:25.687411 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:25.687412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:25.687670 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:25.687736 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:25.687739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.688596 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.688597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:25.689318 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:25.689322 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.689820 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.689821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:25.689902 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:25.690710 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:25.690717 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:25.693142 (+ 2425us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":153,"threads_started":1}
W20260810 04:51:25.693431 30912 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:25.687030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:55073 (local address 127.15.239.254:42407)
0810 04:51:25.687106 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:25.687108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:25.687158 (+ 50us) server_negotiation.cc:407] Connection header received
0810 04:51:25.687277 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:25.687278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:25.687301 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:25.687393 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:25.687840 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.688490 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.689504 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:25.689728 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:25.689822 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:25.693308 (+ 3486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:55073: BlockingRecv error: recv got EOF from 127.15.239.195:55073 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 04:51:26 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:26 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:26.392311 30917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:26.386203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:47203)
0810 04:51:26.386400 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:26.386419 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:26.386490 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:26.386739 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:26.386740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:26.387047 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:26.387142 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:26.387146 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.387995 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.387996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:26.388668 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:26.388670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.389140 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.389140 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:26.389187 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:26.389798 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:26.389804 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:26.392222 (+ 2418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":120,"threads_started":1}
W20260810 04:51:26.392545 30919 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:26.386308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:47203 (local address 127.15.239.254:42407)
0810 04:51:26.386506 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:26.386508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:26.386553 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:51:26.386593 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:26.386594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:26.386613 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:26.386727 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:26.387251 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.387858 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.388786 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.389044 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.389122 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:26.392446 (+ 3324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:47203: BlockingRecv error: recv got EOF from 127.15.239.193:47203 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":116,"threads_started":1}
Aug 10 04:51:26 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:26 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:26.545581 30924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:26.539484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:54887)
0810 04:51:26.539763 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:26.539779 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:26.539904 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:26.540160 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:26.540161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:26.540412 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:26.540484 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:26.540487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.541279 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.541280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:26.541851 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:26.541853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.542409 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.542411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:26.542481 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:26.543208 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:26.543213 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:26.545504 (+ 2291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":143,"threads_started":1}
W20260810 04:51:26.545771 30919 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:26.539658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:54887 (local address 127.15.239.254:42407)
0810 04:51:26.539770 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:26.539773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:26.539875 (+ 102us) server_negotiation.cc:407] Connection header received
0810 04:51:26.540041 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:26.540042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:26.540060 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:26.540149 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:26.540581 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.541170 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.541999 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.542316 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.542390 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:26.545677 (+ 3287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:54887: BlockingRecv error: recv got EOF from 127.15.239.194:54887 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 10 04:51:26 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:26 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:26.699662 30925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:26.693906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:39681)
0810 04:51:26.694175 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:26.694190 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:26.694310 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:26.694510 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:26.694512 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:26.694771 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:26.694839 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:26.694842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.695630 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.695631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:26.696327 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:26.696330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.696752 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.696754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:26.696836 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:26.697417 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:26.697424 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:26.699539 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":135,"threads_started":1}
W20260810 04:51:26.699712 30919 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:26.694028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:39681 (local address 127.15.239.254:42407)
0810 04:51:26.694159 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:26.694162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:26.694295 (+ 133us) server_negotiation.cc:407] Connection header received
0810 04:51:26.694378 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:26.694380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:26.694400 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:26.694473 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:26.694944 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.695529 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.696439 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:26.696655 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:26.696751 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:26.699635 (+ 2884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:39681: BlockingRecv error: recv got EOF from 127.15.239.195:39681 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 10 04:51:27 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:27 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:27.399127 30926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:27.393242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:58351)
0810 04:51:27.393459 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:27.393479 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:27.393549 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:27.393764 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:27.393765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:27.394044 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:27.394116 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:27.394118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.394937 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.394938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:27.395532 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:27.395534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.396132 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.396133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:27.396204 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:27.396717 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:27.396722 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:27.399046 (+ 2324us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":137,"threads_started":1}
W20260810 04:51:27.399319 30927 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:27.393363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:58351 (local address 127.15.239.254:42407)
0810 04:51:27.393549 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:27.393551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:27.393592 (+ 41us) server_negotiation.cc:407] Connection header received
0810 04:51:27.393623 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:27.393624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:27.393638 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:27.393702 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:27.394219 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.394813 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.395624 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.396053 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.396131 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:27.399189 (+ 3058us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:58351: BlockingRecv error: recv got EOF from 127.15.239.193:58351 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":113,"threads_started":1}
Aug 10 04:51:27 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:27 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:27.552119 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:27.546223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:34605)
0810 04:51:27.546442 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:27.546461 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:27.546527 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:27.546712 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:27.546712 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:27.546935 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:27.547005 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:27.547007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.547885 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.547886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:27.548515 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:27.548517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.548947 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.548947 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:27.548995 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:27.549618 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:27.549624 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:27.551989 (+ 2365us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":131,"threads_started":1}
W20260810 04:51:27.552245 30927 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:27.546453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:34605 (local address 127.15.239.254:42407)
0810 04:51:27.546529 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:27.546532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:27.546585 (+ 53us) server_negotiation.cc:407] Connection header received
0810 04:51:27.546618 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:27.546619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:27.546633 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:27.546679 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:27.547128 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.547777 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.548613 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.548855 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.548921 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:27.552165 (+ 3244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:34605: BlockingRecv error: recv got EOF from 127.15.239.194:34605 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 04:51:27 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:27 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:27.706554 30931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:27.700482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:54801)
0810 04:51:27.700760 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:27.700774 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:27.700887 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:27.701108 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:27.701109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:27.701351 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:27.701417 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:27.701420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.702532 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.702534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:27.703114 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:27.703116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.703539 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.703540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:27.703606 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:27.704276 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:27.704282 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:27.706422 (+ 2140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":128,"threads_started":1}
W20260810 04:51:27.706607 30927 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:27.700629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:54801 (local address 127.15.239.254:42407)
0810 04:51:27.700735 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:27.700739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:27.700866 (+ 127us) server_negotiation.cc:407] Connection header received
0810 04:51:27.700984 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:27.700985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:27.701004 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:27.701097 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:27.701544 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.702425 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.703215 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:27.703450 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:27.703541 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:27.706531 (+ 2990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:54801: BlockingRecv error: recv got EOF from 127.15.239.195:54801 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 10 04:51:28 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:28 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:28.406087 30932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:28.399928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:34335)
0810 04:51:28.400315 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:28.400330 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:28.400416 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:28.400611 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:28.400612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:28.400879 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:28.400990 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:28.400993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.402000 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.402001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:28.402575 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:28.402576 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.403018 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.403019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:28.403078 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:28.403634 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:28.403639 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:28.405963 (+ 2324us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":280,"threads_started":1}
W20260810 04:51:28.406152 30934 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:28.400162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:34335 (local address 127.15.239.254:42407)
0810 04:51:28.400360 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:28.400362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:28.400398 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:51:28.400492 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:28.400493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:28.400508 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:28.400581 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:28.401089 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.401895 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.402672 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.402909 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.403016 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:28.406063 (+ 3047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:34335: BlockingRecv error: recv got EOF from 127.15.239.193:34335 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
Aug 10 04:51:28 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:28 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:28.558374 30936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:28.552829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:57107)
0810 04:51:28.553090 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:28.553103 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:28.553182 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:28.553332 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:28.553333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:28.553544 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:28.553612 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:28.553614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.554397 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.554398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:28.554985 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:28.554987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.555336 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.555337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:28.555401 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:28.555963 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:28.555969 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:28.558290 (+ 2321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":184,"threads_started":1}
W20260810 04:51:28.558555 30934 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:28.552928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:57107 (local address 127.15.239.254:42407)
0810 04:51:28.553051 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:28.553054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:28.553183 (+ 129us) server_negotiation.cc:407] Connection header received
0810 04:51:28.553240 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:28.553240 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:28.553265 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:28.553317 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:28.553712 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.554297 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.555066 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.555259 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.555313 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:28.558439 (+ 3126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:57107: BlockingRecv error: recv got EOF from 127.15.239.194:57107 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 10 04:51:28 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:28 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:28.712864 30937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:28.707191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:44555)
0810 04:51:28.707432 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:28.707454 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:28.707573 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:28.707762 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:28.707764 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:28.707996 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:28.708127 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:28.708129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.708898 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.708899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:28.709488 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:28.709490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.709880 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.709881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:28.709949 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:28.710532 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:28.710537 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:28.712784 (+ 2247us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":141,"threads_started":1}
W20260810 04:51:28.713052 30934 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:28.707297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:44555 (local address 127.15.239.254:42407)
0810 04:51:28.707407 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:28.707410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:28.707548 (+ 138us) server_negotiation.cc:407] Connection header received
0810 04:51:28.707643 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:28.707644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:28.707663 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:28.707733 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:28.708212 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.708786 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.709583 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:28.709793 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:28.709882 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:28.712965 (+ 3083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:44555: BlockingRecv error: recv got EOF from 127.15.239.195:44555 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 10 04:51:29 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:29 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:29.413158 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:29.406766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:41733)
0810 04:51:29.407072 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:29.407089 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:29.407177 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:29.407386 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:29.407388 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:29.407645 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:29.407725 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:29.407728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.408829 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.408830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:29.409709 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:29.409713 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.410141 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.410142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:29.410189 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:29.410764 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:29.410770 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:29.413080 (+ 2310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":134,"threads_started":1}
W20260810 04:51:29.413301 30939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:29.406927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:41733 (local address 127.15.239.254:42407)
0810 04:51:29.407092 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:29.407094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:29.407168 (+ 74us) server_negotiation.cc:407] Connection header received
0810 04:51:29.407244 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:29.407245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:29.407258 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:29.407322 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:29.407871 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.408704 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.409821 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.410057 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.410129 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:29.413198 (+ 3069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:41733: BlockingRecv error: recv got EOF from 127.15.239.193:41733 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
Aug 10 04:51:29 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:29 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:29.564884 30941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:29.559159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:59809)
0810 04:51:29.559389 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:29.559401 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:29.559478 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:29.559660 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:29.559661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:29.559893 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:29.559965 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:29.560051 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.560865 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.560867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:29.561457 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:29.561459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.561828 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.561829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:29.561887 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:29.562532 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:29.562538 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:29.564735 (+ 2197us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":122,"threads_started":1}
W20260810 04:51:29.564985 30939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:29.559223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:59809 (local address 127.15.239.254:42407)
0810 04:51:29.559307 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:29.559310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:29.559486 (+ 176us) server_negotiation.cc:407] Connection header received
0810 04:51:29.559532 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:29.559533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:29.559549 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:29.559608 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:29.560179 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.560762 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.561543 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.561749 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.561806 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:29.564912 (+ 3106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:59809: BlockingRecv error: recv got EOF from 127.15.239.194:59809 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 10 04:51:29 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:29 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:29.722988 30944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:29.713579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:57533)
0810 04:51:29.713751 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:29.713789 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:29.713895 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:29.714050 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:29.714051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:29.714282 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:29.714391 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:29.714398 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.715291 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.715292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:29.715891 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:29.715893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.716355 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.716357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:29.716426 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:29.720581 (+ 4155us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:29.720589 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:29.722841 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":89,"threads_started":1}
W20260810 04:51:29.723050 30939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:29.713686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:57533 (local address 127.15.239.254:42407)
0810 04:51:29.713772 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:29.713775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:29.713902 (+ 127us) server_negotiation.cc:407] Connection header received
0810 04:51:29.713973 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:29.713974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:29.713992 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:29.714043 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:29.714493 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.715187 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.716003 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:29.716268 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:29.716356 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:29.722968 (+ 6612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:57533: BlockingRecv error: recv got EOF from 127.15.239.195:57533 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 04:51:30 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:30 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:30.419642 30945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:30.413884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:52267)
0810 04:51:30.414078 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:30.414090 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:30.414160 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:30.414353 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:30.414354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:30.414717 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:30.414812 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:30.414831 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.415737 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.415738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:30.416468 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:30.416471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.416862 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.416863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:30.416928 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:30.417471 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:30.417476 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:30.419552 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":125,"threads_started":1}
W20260810 04:51:30.419813 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:30.413995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:52267 (local address 127.15.239.254:42407)
0810 04:51:30.414142 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:30.414145 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:30.414157 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:30.414216 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:30.414216 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:30.414229 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:30.414296 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:30.414951 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.415648 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.416553 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.416761 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.416817 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:30.419705 (+ 2888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:52267: BlockingRecv error: recv got EOF from 127.15.239.193:52267 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
Aug 10 04:51:30 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:30 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:30.571609 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:30.565581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:53705)
0810 04:51:30.565787 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:30.565804 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:30.565895 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:30.566109 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:30.566110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:30.566354 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:30.566422 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:30.566424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.567360 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.567362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:30.568105 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:30.568108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.568550 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.568551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:30.568621 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:30.569246 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:30.569253 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:30.571489 (+ 2236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
W20260810 04:51:30.571687 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:30.565739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:53705 (local address 127.15.239.254:42407)
0810 04:51:30.565838 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:30.565840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:30.565869 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:51:30.566007 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:30.566008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:30.566023 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:30.566083 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:30.566519 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.567251 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.568205 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.568425 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.568529 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:30.571610 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:53705: BlockingRecv error: recv got EOF from 127.15.239.194:53705 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 04:51:30 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:30 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:30.729004 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:30.723585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:47741)
0810 04:51:30.723771 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:30.723788 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:30.723881 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:30.724097 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:30.724098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:30.724338 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:30.724408 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:30.724410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.725154 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.725155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:30.725729 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:30.725732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.726079 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.726080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:30.726134 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:30.726693 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:30.726698 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:30.728926 (+ 2228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":117,"threads_started":1}
W20260810 04:51:30.729156 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:30.723672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:47741 (local address 127.15.239.254:42407)
0810 04:51:30.723755 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:30.723757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:30.723874 (+ 117us) server_negotiation.cc:407] Connection header received
0810 04:51:30.723935 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:30.723936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:30.723953 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:30.724036 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:30.724487 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.725050 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.725813 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:30.726004 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:30.726057 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:30.729050 (+ 2993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:47741: BlockingRecv error: recv got EOF from 127.15.239.195:47741 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 04:51:31 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:31 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:31.426440 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:31.420291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:41741)
0810 04:51:31.420477 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:31.420491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:31.420568 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:31.420843 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:31.420845 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:31.421133 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:31.421210 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:31.421212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.422186 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.422187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:31.422767 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:31.422769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.423178 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.423179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:31.423235 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:31.423839 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:31.423845 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:31.426324 (+ 2479us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":110,"threads_started":1}
W20260810 04:51:31.426522 30954 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:31.420399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:41741 (local address 127.15.239.254:42407)
0810 04:51:31.420571 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:31.420573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:31.420590 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:51:31.420621 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:31.420622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:31.420671 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:31.420779 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:31.421329 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.422078 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.422872 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.423092 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.423154 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:31.426439 (+ 3285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:41741: BlockingRecv error: recv got EOF from 127.15.239.193:41741 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
Aug 10 04:51:31 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:31 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:31.578030 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:31.572370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:60663)
0810 04:51:31.572601 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:31.572613 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:31.572716 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:31.572917 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:31.572919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:31.573158 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:31.573232 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:31.573234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.574085 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.574086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:31.574663 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:31.574665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.575028 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.575029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:31.575090 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:31.575646 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:31.575651 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:31.577916 (+ 2265us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":135,"threads_started":1}
W20260810 04:51:31.578187 30954 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:31.572500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:60663 (local address 127.15.239.254:42407)
0810 04:51:31.572606 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:31.572608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:31.572717 (+ 109us) server_negotiation.cc:407] Connection header received
0810 04:51:31.572792 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:31.572793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:31.572807 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:31.572862 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:31.573310 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.573990 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.574741 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.574937 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.575004 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:31.578058 (+ 3054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:60663: BlockingRecv error: recv got EOF from 127.15.239.194:60663 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 04:51:31 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:31 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:31.735456 30956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:31.729628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:43223)
0810 04:51:31.729824 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:31.729856 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:31.729933 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:31.730103 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:31.730104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:31.730329 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:31.730400 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:31.730403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.731122 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.731123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:31.731703 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:31.731705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.732120 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.732121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:31.732175 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:31.732790 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:31.732796 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:31.735322 (+ 2526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":113,"threads_started":1}
W20260810 04:51:31.735496 30954 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:31.729756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:43223 (local address 127.15.239.254:42407)
0810 04:51:31.729869 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:31.729871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:31.729915 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:51:31.730004 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:31.730005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:31.730022 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:31.730078 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:31.730472 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.731039 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.731800 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:31.732043 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:31.732105 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:31.735421 (+ 3316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:43223: BlockingRecv error: recv got EOF from 127.15.239.195:43223 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 10 04:51:32 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:32 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:32.433157 30958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:32.427194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:39361)
0810 04:51:32.427437 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:32.427453 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:32.427545 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:32.427762 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:32.427763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:32.428122 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:32.428216 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:32.428219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.429022 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.429023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:32.429614 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:32.429616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.430063 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.430064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:32.430128 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:32.430749 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:32.430755 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:32.433078 (+ 2323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":118,"threads_started":1}
W20260810 04:51:32.433383 30959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:32.427268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:39361 (local address 127.15.239.254:42407)
0810 04:51:32.427481 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:32.427484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:32.427528 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:51:32.427615 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:32.427616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:32.427629 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:32.427752 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:32.428308 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.428910 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.429714 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.429940 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.430065 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:32.433225 (+ 3160us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:39361: BlockingRecv error: recv got EOF from 127.15.239.193:39361 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":111,"threads_started":1}
Aug 10 04:51:32 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:32 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:32.584862 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:32.578665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:36913)
0810 04:51:32.578850 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:32.578866 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:32.578958 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:32.579173 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:32.579175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:32.579426 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:32.579512 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:32.579515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.580397 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.580399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:32.580982 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:32.580984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.581392 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.581393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:32.581460 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:32.582217 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:32.582223 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:32.584781 (+ 2558us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
W20260810 04:51:32.585027 30959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:32.578803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:36913 (local address 127.15.239.254:42407)
0810 04:51:32.578913 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:32.578915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:32.578932 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:51:32.579072 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:32.579073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:32.579089 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:32.579159 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:32.579615 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.580291 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.581080 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.581305 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.581393 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:32.584914 (+ 3521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:36913: BlockingRecv error: recv got EOF from 127.15.239.194:36913 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 10 04:51:32 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:32 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:32.742355 30962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:32.736289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:52683)
0810 04:51:32.736578 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:32.736595 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:32.736720 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:32.736937 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:32.736938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:32.737208 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:32.737277 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:32.737279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.738077 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.738078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:32.738883 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:32.738887 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.739284 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.739285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:32.739344 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:32.739961 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:32.739966 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:32.742274 (+ 2308us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":144,"threads_started":1}
W20260810 04:51:32.742486 30959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:32.736446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:52683 (local address 127.15.239.254:42407)
0810 04:51:32.736577 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:32.736580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:32.736690 (+ 110us) server_negotiation.cc:407] Connection header received
0810 04:51:32.736825 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:32.736826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:32.736850 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:32.736923 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:32.737377 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.737966 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.738951 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:32.739168 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:32.739285 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:32.742391 (+ 3106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:52683: BlockingRecv error: recv got EOF from 127.15.239.195:52683 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 10 04:51:33 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:33 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:33.440001 30963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:33.433864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:48205)
0810 04:51:33.434051 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:33.434062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:33.434127 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:33.434287 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:33.434288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:33.434526 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:33.434592 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:33.434594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.435437 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.435438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:33.436158 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:33.436161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.436749 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.436750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:33.436800 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:33.437364 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:33.437369 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:33.439849 (+ 2480us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
W20260810 04:51:33.440084 30964 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:33.433947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:48205 (local address 127.15.239.254:42407)
0810 04:51:33.434133 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:33.434135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:33.434148 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:51:33.434177 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:33.434178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:33.434191 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:33.434272 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:33.434715 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.435320 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.436354 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.436661 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.436739 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:33.439965 (+ 3226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:48205: BlockingRecv error: recv got EOF from 127.15.239.193:48205 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":109,"threads_started":1}
Aug 10 04:51:33 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:33 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:33.591931 30966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:33.585614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:60649)
0810 04:51:33.585888 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:33.585900 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:33.586008 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:33.586217 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:33.586218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:33.586482 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:33.586548 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:33.586551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.587395 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.587396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:33.588122 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:33.588125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.588610 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.588612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:33.588693 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:33.589375 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:33.589381 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:33.591797 (+ 2416us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":128,"threads_started":1}
W20260810 04:51:33.591993 30964 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:33.585731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:60649 (local address 127.15.239.254:42407)
0810 04:51:33.585833 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:33.585836 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:33.585982 (+ 146us) server_negotiation.cc:407] Connection header received
0810 04:51:33.586107 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:33.586108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:33.586125 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:33.586194 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:33.586648 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.587288 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.588232 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.588505 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.588608 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:33.591915 (+ 3307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:60649: BlockingRecv error: recv got EOF from 127.15.239.194:60649 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 04:51:33 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:33 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:33.748874 30967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:33.743117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:53315)
0810 04:51:33.743313 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:33.743330 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:33.743404 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:33.743600 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:33.743602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:33.743849 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:33.743915 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:33.743918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.744704 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.744705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:33.745311 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:33.745313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.745669 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.745670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:33.745720 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:33.746284 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:33.746289 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:33.748781 (+ 2492us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":114,"threads_started":1}
W20260810 04:51:33.748958 30964 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:33.743258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:53315 (local address 127.15.239.254:42407)
0810 04:51:33.743341 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:33.743343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:33.743401 (+ 58us) server_negotiation.cc:407] Connection header received
0810 04:51:33.743473 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:33.743474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:33.743492 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:33.743543 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:33.744007 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.744624 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.745399 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:33.745596 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:33.745655 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:33.748896 (+ 3241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:53315: BlockingRecv error: recv got EOF from 127.15.239.195:53315 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 04:51:34 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:34 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:34.446624 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:34.440695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:58609)
0810 04:51:34.440873 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:34.440887 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:34.440982 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:34.441260 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:34.441262 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:34.441621 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:34.441710 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:34.441714 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.442545 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.442546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:34.443161 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:34.443163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.443624 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.443625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:34.443683 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:34.444363 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:34.444368 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:34.446542 (+ 2174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
W20260810 04:51:34.446851 30969 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:34.440812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:58609 (local address 127.15.239.254:42407)
0810 04:51:34.441039 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:34.441042 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:34.441055 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:51:34.441091 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:34.441092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:34.441115 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:34.441210 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:34.441816 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.442438 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.443273 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.443538 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.443613 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:34.446733 (+ 3120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:58609: BlockingRecv error: recv got EOF from 127.15.239.193:58609 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":84,"threads_started":1}
Aug 10 04:51:34 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:34 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:34.597944 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:34.592591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:57989)
0810 04:51:34.592821 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:34.592833 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:34.592902 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:34.593085 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:34.593086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:34.593313 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:34.593379 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:34.593381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.594108 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.594109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:34.594692 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:34.594694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.595235 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.595236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:34.595304 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:34.595813 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:34.595838 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:34.597854 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":142,"threads_started":1}
W20260810 04:51:34.598065 30969 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:34.592707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:57989 (local address 127.15.239.254:42407)
0810 04:51:34.592781 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:34.592783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:34.592894 (+ 111us) server_negotiation.cc:407] Connection header received
0810 04:51:34.592978 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:34.592992 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:34.593008 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:34.593058 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:34.593446 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.594034 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.594795 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.595143 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.595221 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:34.597970 (+ 2749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:57989: BlockingRecv error: recv got EOF from 127.15.239.194:57989 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 04:51:34 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:34 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:34.759171 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:34.749438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:51519)
0810 04:51:34.749616 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:34.749628 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:34.749704 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:34.749840 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:34.749840 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:34.750079 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:34.750148 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:34.750150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.750889 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.750890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:34.751491 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:34.751493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.751879 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.751880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:34.751934 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:34.756694 (+ 4760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:34.756701 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:34.759040 (+ 2339us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
W20260810 04:51:34.759261 30969 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:34.749548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:51519 (local address 127.15.239.254:42407)
0810 04:51:34.749614 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:34.749616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:34.749680 (+ 64us) server_negotiation.cc:407] Connection header received
0810 04:51:34.749758 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:34.749759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:34.749775 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:34.749816 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:34.750220 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.750789 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.751579 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:34.751791 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:34.751849 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:34.759174 (+ 7325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:51519: BlockingRecv error: recv got EOF from 127.15.239.195:51519 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 10 04:51:35 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:35 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:35.453588 30975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:35.447247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:60679)
0810 04:51:35.447473 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:35.447499 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:35.447575 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:35.447786 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:35.447787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:35.448112 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:35.448182 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:35.448184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.448995 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.448996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:35.449591 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:35.449594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.450074 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.450076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:35.450158 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:35.450930 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:35.450936 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:35.453488 (+ 2552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":129,"threads_started":1}
W20260810 04:51:35.453704 30976 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:35.447387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:60679 (local address 127.15.239.254:42407)
0810 04:51:35.447563 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:35.447565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:35.447577 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:51:35.447641 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:35.447642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:35.447654 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:35.447725 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:35.448280 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.448879 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.449701 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.449939 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.450025 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:35.453614 (+ 3589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:60679: BlockingRecv error: recv got EOF from 127.15.239.193:60679 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
Aug 10 04:51:35 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:35 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:35.604218 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:35.598647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:54899)
0810 04:51:35.598890 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:35.598906 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:35.599034 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:35.599210 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:35.599212 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:35.599473 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:35.599544 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:35.599546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.600404 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.600405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:35.600980 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:35.600982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.601387 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.601388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:35.601447 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:35.602026 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:35.602031 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:35.604100 (+ 2069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":139,"threads_started":1}
W20260810 04:51:35.604259 30976 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:35.598837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:54899 (local address 127.15.239.254:42407)
0810 04:51:35.598927 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:35.598931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:35.599009 (+ 78us) server_negotiation.cc:407] Connection header received
0810 04:51:35.599135 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:35.599135 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:35.599151 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:35.599204 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:35.599636 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.600311 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.601087 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.601300 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.601388 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:35.604188 (+ 2800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:54899: BlockingRecv error: recv got EOF from 127.15.239.194:54899 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 04:51:35 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:35 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:35.765241 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:35.759834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:42639)
0810 04:51:35.760092 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:35.760103 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:35.760174 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:35.760321 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:35.760322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:35.760532 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:35.760599 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:35.760602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.761308 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.761309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:35.761947 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:35.761950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.762480 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.762481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:35.762531 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:35.763143 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:35.763149 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:35.765163 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":143,"threads_started":1}
W20260810 04:51:35.765341 30976 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:35.759905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:42639 (local address 127.15.239.254:42407)
0810 04:51:35.759979 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:35.759981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:35.760167 (+ 186us) server_negotiation.cc:407] Connection header received
0810 04:51:35.760228 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:35.760228 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:35.760246 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:35.760306 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:35.760663 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.761231 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.762062 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:35.762400 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:35.762481 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:35.765265 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:42639: BlockingRecv error: recv got EOF from 127.15.239.195:42639 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 04:51:36 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:36 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:36.460069 30979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:36.454467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:36975)
0810 04:51:36.454651 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:36.454662 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:36.454728 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:36.454917 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:36.454918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:36.455274 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:36.455381 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:36.455385 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.456203 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.456204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:36.456774 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:36.456776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.457156 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.457156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:36.457203 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:36.457750 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:36.457756 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:36.459944 (+ 2188us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
W20260810 04:51:36.460197 30980 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:36.454529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:36975 (local address 127.15.239.254:42407)
0810 04:51:36.454733 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:36.454735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:36.454746 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:36.454777 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:36.454778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:36.454791 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:36.454911 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:36.455478 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.456130 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.456859 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.457084 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.457145 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:36.460111 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:36975: BlockingRecv error: recv got EOF from 127.15.239.193:36975 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":125,"threads_started":1}
Aug 10 04:51:36 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:36 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:36.610741 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:36.604886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:43367)
0810 04:51:36.605114 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:36.605126 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:36.605201 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:36.605559 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:36.605560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:36.605794 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:36.605866 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:36.605868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.606651 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.606652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:36.607233 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:36.607234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.607604 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.607605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:36.607649 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:36.608390 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:36.608397 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:36.610665 (+ 2268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":134,"threads_started":1}
W20260810 04:51:36.610872 30980 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:36.604995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:43367 (local address 127.15.239.254:42407)
0810 04:51:36.605084 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:36.605086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:36.605194 (+ 108us) server_negotiation.cc:407] Connection header received
0810 04:51:36.605276 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:36.605277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:36.605291 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:36.605355 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:36.605966 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.606561 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.607309 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.607533 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.607591 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:36.610784 (+ 3193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:43367: BlockingRecv error: recv got EOF from 127.15.239.194:43367 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 04:51:36 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:36 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.195@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:36.771371 30985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:36.765883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.195:41371)
0810 04:51:36.766098 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:36.766108 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:36.766192 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:36.766380 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:36.766381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:36.766611 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:36.766675 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:36.766677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.767435 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.767436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:36.768109 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:36.768112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.768503 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.768504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:36.768573 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:36.769120 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:36.769126 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:36.771276 (+ 2150us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":109,"threads_started":1}
W20260810 04:51:36.771446 30980 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:36.765951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:41371 (local address 127.15.239.254:42407)
0810 04:51:36.766040 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:36.766043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:36.766168 (+ 125us) server_negotiation.cc:407] Connection header received
0810 04:51:36.766267 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:36.766268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:36.766298 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:36.766367 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:36.766767 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.767347 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.768205 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:36.768409 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:36.768501 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:36.771385 (+ 2884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.195:41371: BlockingRecv error: recv got EOF from 127.15.239.195:41371 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 04:51:37 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:37 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.193@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:37.466307 30986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:37.460660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.193:38959)
0810 04:51:37.460851 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:37.460863 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:37.460929 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:37.461111 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:37.461112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:37.461332 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:37.461403 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:37.461405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.462173 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.462175 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:37.462782 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:37.462784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.463242 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.463244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:37.463296 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:37.463822 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:37.463828 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:37.466180 (+ 2352us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":120,"threads_started":1}
W20260810 04:51:37.466449 30987 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:37.460764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:38959 (local address 127.15.239.254:42407)
0810 04:51:37.460916 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:37.460918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:37.460927 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:51:37.461011 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:37.461012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:37.461026 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:37.461090 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:37.461479 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.462084 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.462860 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.463148 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.463225 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:37.466345 (+ 3120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.193:38959: BlockingRecv error: recv got EOF from 127.15.239.193:38959 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
Aug 10 04:51:37 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 04:51:37 dist-test-slave-kvfs krb5kdc[29345](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.239.194@KRBTEST.COM for oryx/127.15.239.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 04:51:37.617709 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:37.611756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:42407 (local address 127.15.239.194:43295)
0810 04:51:37.611951 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:37.611967 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:37.612110 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:37.612302 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:37.612303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:37.612533 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:37.612607 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:37.612610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.613501 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.613502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:37.614236 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:37.614239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.614728 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.614729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:37.614796 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:37.615449 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:37.615458 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:37.617622 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.239.254:42407: Server oryx/127.15.239.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
W20260810 04:51:37.617849 30987 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:37.611891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:43295 (local address 127.15.239.254:42407)
0810 04:51:37.611965 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:37.611967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:37.612060 (+ 93us) server_negotiation.cc:407] Connection header received
0810 04:51:37.612198 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:37.612199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:37.612215 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:37.612278 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:37.612739 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.613328 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.614339 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.614644 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.614712 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:37.617751 (+ 3039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.239.194:43295: BlockingRecv error: recv got EOF from 127.15.239.194:43295 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:51:37.654687 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 30247
I20260810 04:51:37.671401 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 30488
I20260810 04:51:37.696909 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 30688
I20260810 04:51:37.709033 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 30134
2026-08-10T04:51:37Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18129 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T04:51:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:37Z Disabled control of system clock
I20260810 04:51:37.748425 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37227
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:37227
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 04:51:37.842907 30995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:37.843253 30995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:37.843283 30995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:37.844614 30995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:37.844659 30995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:37.844672 30995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:37.844686 30995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:37.844698 30995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:37.846168 30995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:37227
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:37.846491 30995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:37.846872 30995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:37.853101 31008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:37.853085 31011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:37.853132 30995 server_base.cc:1034] running on GCE node
W20260810 04:51:37.853078 31005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:37.853688 30995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:37.854054 30995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:37.855204 30995 hybrid_clock.cc:648] HybridClock initialized: now 1786337497855187 us; error 45 us; skew 500 ppm
I20260810 04:51:37.856734 30995 webserver.cc:460] Webserver started at http://127.15.239.254:35727/ using document root <none> and password file <none>
I20260810 04:51:37.857059 30995 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:37.857111 30995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:37.857314 30995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:37.858600 30995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "d14506e9b5cf46a09ac31500e6cddeb9"
format_stamp: "Formatted at 2026-08-10 04:51:37 on dist-test-slave-kvfs"
server_key: "c8b0a60acb04a9051b70f1100db5d9a2"
server_key_iv: "92fcd390efffa208f6ce940751130e61"
server_key_version: "encryptionkey@0"
I20260810 04:51:37.859033 30995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "d14506e9b5cf46a09ac31500e6cddeb9"
format_stamp: "Formatted at 2026-08-10 04:51:37 on dist-test-slave-kvfs"
server_key: "c8b0a60acb04a9051b70f1100db5d9a2"
server_key_iv: "92fcd390efffa208f6ce940751130e61"
server_key_version: "encryptionkey@0"
I20260810 04:51:37.860613 30995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:51:37.861482 31017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:37.861707 30995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:37.861819 30995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "d14506e9b5cf46a09ac31500e6cddeb9"
format_stamp: "Formatted at 2026-08-10 04:51:37 on dist-test-slave-kvfs"
server_key: "c8b0a60acb04a9051b70f1100db5d9a2"
server_key_iv: "92fcd390efffa208f6ce940751130e61"
server_key_version: "encryptionkey@0"
I20260810 04:51:37.861900 30995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:37.885819 30995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:37.886299 30995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:37.886498 30995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:37.891934 30995 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:37227
I20260810 04:51:37.891984 31104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:37227 every 8 connection(s)
I20260810 04:51:37.892468 30995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:37.893364 31109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:37.894062 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 30995
I20260810 04:51:37.894207 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:37.894459 16319 external_mini_cluster.cc:1428] Setting key e29a8c20e12e832f315adb3a279ff388
I20260810 04:51:37.897145 31109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9: Bootstrap starting.
I20260810 04:51:37.897953 31109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:37.898351 31109 log.cc:824] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:37.899173 31109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9: No bootstrap required, opened a new log
I20260810 04:51:37.900918 31109 raft_consensus.cc:348] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37227 } }
I20260810 04:51:37.901134 31109 raft_consensus.cc:374] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:37.901207 31109 raft_consensus.cc:729] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d14506e9b5cf46a09ac31500e6cddeb9, State: Initialized, Role: FOLLOWER
I20260810 04:51:37.901480 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:37.895208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48702 (local address 127.15.239.254:37227)
0810 04:51:37.895462 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:37.895471 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:37.895502 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:51:37.895994 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:37.896001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:37.896132 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:37.896284 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:37.896595 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.897722 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.898897 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:37.899395 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:37.899548 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:37.900504 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:37.900509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:37.900510 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:37.900714 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:37.900751 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:37.900764 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:37.900839 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:37.900948 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 04:51:37.901040 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":103,"threads_started":1}
I20260810 04:51:37.901321 31109 consensus_queue.cc:260] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37227 } }
I20260810 04:51:37.901682 31109 raft_consensus.cc:388] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:37.901727 31109 raft_consensus.cc:482] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:37.901778 31109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:37.902573 31109 raft_consensus.cc:504] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37227 } }
I20260810 04:51:37.902673 31109 leader_election.cc:302] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d14506e9b5cf46a09ac31500e6cddeb9; no voters:
I20260810 04:51:37.902819 31109 leader_election.cc:288] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:37.902872 31115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:37.903091 31115 raft_consensus.cc:686] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [term 1 LEADER]: Becoming Leader. State: Replica: d14506e9b5cf46a09ac31500e6cddeb9, State: Running, Role: LEADER
I20260810 04:51:37.903174 31109 sys_catalog.cc:564] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:37.903215 31115 consensus_queue.cc:237] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37227 } }
I20260810 04:51:37.903579 31115 sys_catalog.cc:455] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d14506e9b5cf46a09ac31500e6cddeb9. Latest consensus state: current_term: 1 leader_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37227 } } }
I20260810 04:51:37.903664 31115 sys_catalog.cc:458] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:37.903606 31116 sys_catalog.cc:455] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d14506e9b5cf46a09ac31500e6cddeb9" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37227 } } }
I20260810 04:51:37.903873 31116 sys_catalog.cc:458] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9 [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:37.904322 31123 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:37.904911 31123 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:37.906669 31123 catalog_manager.cc:1347] Generated new cluster ID: 0bfd1e3cb233499dbc582062bda932b3
I20260810 04:51:37.906711 31123 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:37.915122 31123 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:37.915696 31123 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:37.927021 31123 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d14506e9b5cf46a09ac31500e6cddeb9: Generated new TSK 0
I20260810 04:51:37.927300 31123 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:51:37.930519 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37227
--builtin_ntp_servers=127.15.239.212:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 04:51:38.040632 31142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:38.040941 31142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:38.040980 31142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:38.042309 31142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:38.042388 31142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:38.042434 31142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:38.043979 31142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:38.044363 31142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:38.044767 31142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:38.051338 31150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.051384 31149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.051379 31152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:38.051702 31142 server_base.cc:1034] running on GCE node
I20260810 04:51:38.052000 31142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:38.052371 31142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:38.053577 31142 hybrid_clock.cc:648] HybridClock initialized: now 1786337498053554 us; error 40 us; skew 500 ppm
I20260810 04:51:38.055205 31142 webserver.cc:460] Webserver started at http://127.15.239.193:34877/ using document root <none> and password file <none>
I20260810 04:51:38.055532 31142 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:38.055617 31142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:38.055799 31142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:38.057152 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "44bae0d4ea264398aaf736c021de0b33"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "ef0df986747d77a857d5b6403041a790"
server_key_iv: "29c1d8ca1cf2915233c0e4ad8c574314"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.057576 31142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "44bae0d4ea264398aaf736c021de0b33"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "ef0df986747d77a857d5b6403041a790"
server_key_iv: "29c1d8ca1cf2915233c0e4ad8c574314"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.059072 31142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:51:38.060010 31159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.060262 31142 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:38.060369 31142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "44bae0d4ea264398aaf736c021de0b33"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "ef0df986747d77a857d5b6403041a790"
server_key_iv: "29c1d8ca1cf2915233c0e4ad8c574314"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.060454 31142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:38.087229 31142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:38.087659 31142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:38.087797 31142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:38.088150 31142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:38.088573 31142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:38.088610 31142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.088637 31142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:38.088650 31142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.095661 31142 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:32887
I20260810 04:51:38.095769 31332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:32887 every 8 connection(s)
I20260810 04:51:38.096289 31142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:38.099483 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 31142
I20260810 04:51:38.099607 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:38.099830 16319 external_mini_cluster.cc:1428] Setting key c527d3ac5e575d827dff9c6a1a6b8dba
I20260810 04:51:38.101018 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37227
--builtin_ntp_servers=127.15.239.212:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 04:51:38.103169 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.097267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:40413 (local address 127.15.239.254:37227)
0810 04:51:38.097395 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.097398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.097674 (+ 276us) server_negotiation.cc:407] Connection header received
0810 04:51:38.098291 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.098293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.098305 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.098378 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.099166 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.099823 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.101384 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.101611 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.101693 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:38.102790 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:38.102792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:38.102792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:38.102798 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:38.102822 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:38.102827 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:38.102883 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:38.103029 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 04:51:38.103072 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260810 04:51:38.103449 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.097244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37227 (local address 127.15.239.193:40413)
0810 04:51:38.097512 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:38.097565 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:38.098175 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:38.098482 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:38.098486 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:38.098497 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:38.099085 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:38.099089 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.099938 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.099940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:38.101277 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:38.101282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.101704 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.101706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:38.101873 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:38.102588 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:38.102588 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:38.102637 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:38.102674 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:38.102898 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:38.102905 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:38.102908 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:38.103029 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 04:51:38.103160 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":138,"threads_started":1}
I20260810 04:51:38.104084 31333 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37227
I20260810 04:51:38.104214 31333 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:38.104472 31333 heartbeater.cc:511] Master 127.15.239.254:37227 requested a full tablet report, sending...
I20260810 04:51:38.105235 31047 ts_manager.cc:194] Registered new tserver with Master: 44bae0d4ea264398aaf736c021de0b33 (127.15.239.193:32887)
I20260810 04:51:38.105938 31047 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.193:40413
W20260810 04:51:38.199466 31338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:38.199770 31338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:38.199807 31338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:38.201056 31338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:38.201124 31338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:38.201165 31338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:38.202632 31338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:38.202921 31338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:38.203305 31338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:38.209187 31350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.209247 31348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.209223 31345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:38.209409 31338 server_base.cc:1034] running on GCE node
I20260810 04:51:38.209637 31338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:38.209884 31338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:38.211041 31338 hybrid_clock.cc:648] HybridClock initialized: now 1786337498211029 us; error 31 us; skew 500 ppm
I20260810 04:51:38.212632 31338 webserver.cc:460] Webserver started at http://127.15.239.194:46797/ using document root <none> and password file <none>
I20260810 04:51:38.212874 31338 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:38.212921 31338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:38.213033 31338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:38.214242 31338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "9b4ab30f018b4b6d8bd0b2f41079f4bf"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "e661784994b2af0a3433baaae4e575b5"
server_key_iv: "225c2f0ce6ce19a1af5fc5c64c9b7ac2"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.214602 31338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "9b4ab30f018b4b6d8bd0b2f41079f4bf"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "e661784994b2af0a3433baaae4e575b5"
server_key_iv: "225c2f0ce6ce19a1af5fc5c64c9b7ac2"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.216161 31338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:51:38.217046 31357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.217268 31338 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:38.217414 31338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "9b4ab30f018b4b6d8bd0b2f41079f4bf"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "e661784994b2af0a3433baaae4e575b5"
server_key_iv: "225c2f0ce6ce19a1af5fc5c64c9b7ac2"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.217504 31338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:38.234309 31338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:38.234750 31338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:38.234946 31338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:38.235260 31338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:38.235694 31338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:38.235752 31338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.235793 31338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:38.235822 31338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.243516 31338 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:40965
I20260810 04:51:38.243564 31520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:40965 every 8 connection(s)
I20260810 04:51:38.244005 31338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:38.249563 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 31338
I20260810 04:51:38.249702 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:38.249953 16319 external_mini_cluster.cc:1428] Setting key cc4b5263be9885201e199080cecf5f9f
I20260810 04:51:38.250440 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.244992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:47869 (local address 127.15.239.254:37227)
0810 04:51:38.245082 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.245084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.245384 (+ 300us) server_negotiation.cc:407] Connection header received
0810 04:51:38.245990 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.245991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.246004 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.246063 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.246979 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.247558 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.248812 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.249026 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.249095 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:38.250091 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:38.250093 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:38.250093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:38.250099 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:38.250124 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:38.250129 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:38.250193 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:38.250303 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 04:51:38.250344 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:51:38.250739 31523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.244969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37227 (local address 127.15.239.194:47869)
0810 04:51:38.245232 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:38.245276 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:38.245883 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:38.246134 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:38.246138 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:38.246148 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:38.246895 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:38.246902 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.247659 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.247660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:38.248648 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:38.248650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.249114 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.249115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:38.249243 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:38.249896 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:38.249897 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:38.249933 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:38.249966 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:38.250196 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:38.250202 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:38.250206 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:38.250295 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 04:51:38.250417 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":144,"threads_started":1}
I20260810 04:51:38.251266 31521 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37227
I20260810 04:51:38.251333 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37227
--builtin_ntp_servers=127.15.239.212:37231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 04:51:38.251398 31521 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:38.251627 31521 heartbeater.cc:511] Master 127.15.239.254:37227 requested a full tablet report, sending...
I20260810 04:51:38.252126 31047 ts_manager.cc:194] Registered new tserver with Master: 9b4ab30f018b4b6d8bd0b2f41079f4bf (127.15.239.194:40965)
I20260810 04:51:38.252687 31047 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.194:47869
W20260810 04:51:38.349896 31524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:38.350199 31524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:38.350238 31524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:38.351480 31524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:38.351553 31524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:38.351595 31524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:38.353129 31524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:37231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:38.353456 31524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:38.353832 31524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:38.359710 31531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.359753 31539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.359723 31533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:38.360091 31524 server_base.cc:1034] running on GCE node
I20260810 04:51:38.360311 31524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:38.360601 31524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:38.361747 31524 hybrid_clock.cc:648] HybridClock initialized: now 1786337498361726 us; error 41 us; skew 500 ppm
I20260810 04:51:38.363224 31524 webserver.cc:460] Webserver started at http://127.15.239.195:37037/ using document root <none> and password file <none>
I20260810 04:51:38.363574 31524 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:38.363631 31524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:38.363795 31524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:38.365162 31524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "0d466e076cca423c8edb180dd6ec0d90"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "1fce97016ded5470bcd8a60e11fa8131"
server_key_iv: "073406588744de5ec4de11767fa98738"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.365597 31524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "0d466e076cca423c8edb180dd6ec0d90"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "1fce97016ded5470bcd8a60e11fa8131"
server_key_iv: "073406588744de5ec4de11767fa98738"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.367192 31524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:38.369238 31546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.369467 31524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 04:51:38.369580 31524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "0d466e076cca423c8edb180dd6ec0d90"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "1fce97016ded5470bcd8a60e11fa8131"
server_key_iv: "073406588744de5ec4de11767fa98738"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.369664 31524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:38.390887 31524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:38.391336 31524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:38.391525 31524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:38.391814 31524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:38.392349 31524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:38.392401 31524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.392431 31524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:38.392443 31524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.399926 31524 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:40779
I20260810 04:51:38.399981 31722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:40779 every 8 connection(s)
I20260810 04:51:38.400467 31524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:38.407626 31113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.401482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:49597 (local address 127.15.239.254:37227)
0810 04:51:38.401596 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.401600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.401848 (+ 248us) server_negotiation.cc:407] Connection header received
0810 04:51:38.402576 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.402578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.402596 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.402656 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.403677 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.404527 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.405946 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.406190 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.406289 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:38.407269 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:38.407271 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:38.407272 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:38.407278 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:38.407296 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:38.407301 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:38.407365 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:38.407476 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 04:51:38.407521 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:51:38.407907 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.401428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37227 (local address 127.15.239.195:49597)
0810 04:51:38.401694 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:38.401741 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:38.402434 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:38.402754 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:38.402759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:38.402770 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:38.403552 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:38.403559 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.404643 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.404645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:38.405846 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:38.405849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:38.406300 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:38.406301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:38.406470 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:38.407101 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:38.407102 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:38.407139 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:38.407168 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:38.407372 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:38.407378 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:38.407382 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:38.407479 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 04:51:38.407620 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260810 04:51:38.408470 31723 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37227
I20260810 04:51:38.408593 31723 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:38.408838 31723 heartbeater.cc:511] Master 127.15.239.254:37227 requested a full tablet report, sending...
I20260810 04:51:38.409114 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 31524
I20260810 04:51:38.409212 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:38.409341 31047 ts_manager.cc:194] Registered new tserver with Master: 0d466e076cca423c8edb180dd6ec0d90 (127.15.239.195:40779)
I20260810 04:51:38.409441 16319 external_mini_cluster.cc:1428] Setting key 35e4bd2b47c77e5a96f28c243bd0ab1b
I20260810 04:51:38.409798 31047 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.195:49597
I20260810 04:51:38.410434 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 04:51:38.412580 31113 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:38.411973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48708 (local address 127.15.239.254:37227)
0810 04:51:38.412087 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.412090 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.412192 (+ 102us) server_negotiation.cc:407] Connection header received
0810 04:51:38.412275 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.412276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.412287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.412345 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.412494 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48708: BlockingRecv error: recv got EOF from 127.0.0.1:48708 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 04:51:38.412707 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 31142
I20260810 04:51:38.429284 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 31338
I20260810 04:51:38.442750 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 31524
I20260810 04:51:38.454963 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 30995
2026-08-10T04:51:38Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (743 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T04:51:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:38Z Disabled control of system clock
I20260810 04:51:38.491886 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44603
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:35037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:44603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:51:38.586982 31738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:38.587239 31738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:38.587261 31738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:38.588490 31738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:38.588534 31738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:38.588547 31738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:38.588559 31738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:38.588572 31738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:38.589885 31738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:44603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:38.590126 31738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:38.590411 31738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:38.595913 31751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.595942 31748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.595983 31754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:38.596298 31738 server_base.cc:1034] running on GCE node
I20260810 04:51:38.596619 31738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:38.596949 31738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:38.598114 31738 hybrid_clock.cc:648] HybridClock initialized: now 1786337498598107 us; error 55 us; skew 500 ppm
I20260810 04:51:38.599720 31738 webserver.cc:460] Webserver started at http://127.15.239.254:38695/ using document root <none> and password file <none>
I20260810 04:51:38.600081 31738 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:38.600163 31738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:38.600342 31738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:38.601598 31738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "0f37589aad2b41c3a420329d0c3eb4fb"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "78625097d709ae889b6fc6118096d11d"
server_key_iv: "f352f91105389e79c299364fb063b8e1"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.602022 31738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "0f37589aad2b41c3a420329d0c3eb4fb"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "78625097d709ae889b6fc6118096d11d"
server_key_iv: "f352f91105389e79c299364fb063b8e1"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.603550 31738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:38.604470 31763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.604663 31738 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:51:38.604786 31738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "0f37589aad2b41c3a420329d0c3eb4fb"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "78625097d709ae889b6fc6118096d11d"
server_key_iv: "f352f91105389e79c299364fb063b8e1"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.604871 31738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:38.608659 31738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:38.608987 31738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:38.609141 31738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:38.614215 31738 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:44603
I20260810 04:51:38.614264 31843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:44603 every 8 connection(s)
I20260810 04:51:38.614622 31738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:38.615666 31844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:38.617616 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 31738
I20260810 04:51:38.617736 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:38.617990 16319 external_mini_cluster.cc:1428] Setting key 52487abdfd2384a2b145ec3baabcfb37
I20260810 04:51:38.618847 31844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb: Bootstrap starting.
I20260810 04:51:38.619555 31844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:38.619978 31844 log.cc:824] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:38.620951 31844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb: No bootstrap required, opened a new log
I20260810 04:51:38.621135 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.618621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44304 (local address 127.15.239.254:44603)
0810 04:51:38.618874 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.618883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.618937 (+ 54us) server_negotiation.cc:407] Connection header received
0810 04:51:38.619414 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.619422 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.619477 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.619643 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.620494 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:38.620499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:38.620499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:38.620503 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:38.620581 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:38.620599 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:38.620694 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:38.620801 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 04:51:38.620868 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":104,"threads_started":1}
I20260810 04:51:38.623234 31844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44603 } }
I20260810 04:51:38.623438 31844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:38.623472 31844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f37589aad2b41c3a420329d0c3eb4fb, State: Initialized, Role: FOLLOWER
I20260810 04:51:38.623596 31844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44603 } }
I20260810 04:51:38.623677 31844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:38.623719 31844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:38.623757 31844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:38.624410 31844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44603 } }
I20260810 04:51:38.624511 31844 leader_election.cc:302] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f37589aad2b41c3a420329d0c3eb4fb; no voters:
I20260810 04:51:38.624645 31844 leader_election.cc:288] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:38.624732 31852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:38.624902 31852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [term 1 LEADER]: Becoming Leader. State: Replica: 0f37589aad2b41c3a420329d0c3eb4fb, State: Running, Role: LEADER
I20260810 04:51:38.624962 31844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:38.625028 31852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44603 } }
I20260810 04:51:38.625490 31853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44603 } } }
I20260810 04:51:38.625469 31854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f37589aad2b41c3a420329d0c3eb4fb. Latest consensus state: current_term: 1 leader_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f37589aad2b41c3a420329d0c3eb4fb" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44603 } } }
I20260810 04:51:38.625631 31853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:38.625643 31854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:38.625912 31863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:38.626543 31863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:38.628346 31863 catalog_manager.cc:1347] Generated new cluster ID: 2581a161ba7744d2bd92ae4bdc026c04
I20260810 04:51:38.628403 31863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:51:38.655251 31863 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:38.655517 31863 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:38.664420 31863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f37589aad2b41c3a420329d0c3eb4fb: Generated new TSK 0
I20260810 04:51:38.664707 31863 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:51:38.668605 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44603
--builtin_ntp_servers=127.15.239.212:35037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:51:38.779232 31877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:38.779484 31877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:38.779508 31877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:38.780889 31877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:38.780941 31877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:38.780988 31877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:38.782456 31877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:38.782752 31877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:38.783120 31877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:38.788904 31883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.788936 31887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.788942 31884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:38.789356 31877 server_base.cc:1034] running on GCE node
I20260810 04:51:38.789604 31877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:38.789841 31877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:38.791018 31877 hybrid_clock.cc:648] HybridClock initialized: now 1786337498791000 us; error 44 us; skew 500 ppm
I20260810 04:51:38.792583 31877 webserver.cc:460] Webserver started at http://127.15.239.193:45625/ using document root <none> and password file <none>
I20260810 04:51:38.792858 31877 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:38.792958 31877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:38.793123 31877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:38.794391 31877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "6c26f7d60f32441e8d6a090e2022feb8"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "2e634b4c0ac4c373a1bcd21fc1733910"
server_key_iv: "65ee6c182bc8a39aee8205d6565c1908"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.794790 31877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "6c26f7d60f32441e8d6a090e2022feb8"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "2e634b4c0ac4c373a1bcd21fc1733910"
server_key_iv: "65ee6c182bc8a39aee8205d6565c1908"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.796301 31877 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:38.797101 31898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.797278 31877 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:51:38.797397 31877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "6c26f7d60f32441e8d6a090e2022feb8"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "2e634b4c0ac4c373a1bcd21fc1733910"
server_key_iv: "65ee6c182bc8a39aee8205d6565c1908"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.797482 31877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:38.801141 31877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:38.801434 31877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:38.801581 31877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:38.801810 31877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:38.802158 31877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:38.802214 31877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.802255 31877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:38.802284 31877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.809551 31877 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:43175
I20260810 04:51:38.809592 32058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:43175 every 8 connection(s)
I20260810 04:51:38.810009 31877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:38.813508 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.810923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:52729 (local address 127.15.239.254:44603)
0810 04:51:38.810994 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.810996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.811273 (+ 277us) server_negotiation.cc:407] Connection header received
0810 04:51:38.811820 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.811821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.811827 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.811894 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.813252 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:38.813254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:38.813254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:38.813259 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:38.813276 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:38.813280 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:38.813334 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:38.813422 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:51:38.813438 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:51:38.813722 32067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.810893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44603 (local address 127.15.239.193:52729)
0810 04:51:38.811118 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:38.811167 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:38.811724 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:38.811979 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:38.811984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:38.811994 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:38.813088 (+ 1094us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:38.813089 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:38.813122 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:38.813157 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:38.813347 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:38.813353 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:38.813356 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:38.813420 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:51:38.813485 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":113,"threads_started":1}
I20260810 04:51:38.814272 32060 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44603
I20260810 04:51:38.814373 32060 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:38.814518 32060 heartbeater.cc:511] Master 127.15.239.254:44603 requested a full tablet report, sending...
I20260810 04:51:38.815127 31787 ts_manager.cc:194] Registered new tserver with Master: 6c26f7d60f32441e8d6a090e2022feb8 (127.15.239.193:43175)
I20260810 04:51:38.817274 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 31877
I20260810 04:51:38.817389 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:38.817612 16319 external_mini_cluster.cc:1428] Setting key 0449616620eee9598b96f835eb59133a
I20260810 04:51:38.818629 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44603
--builtin_ntp_servers=127.15.239.212:35037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:51:38.914487 32068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:38.914758 32068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:38.914783 32068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:38.915922 32068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:38.915966 32068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:38.915993 32068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:38.917436 32068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:38.917670 32068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:38.917989 32068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:38.923863 32078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.923882 32076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:38.923877 32075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:38.924191 32068 server_base.cc:1034] running on GCE node
I20260810 04:51:38.924499 32068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:38.924827 32068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:38.925984 32068 hybrid_clock.cc:648] HybridClock initialized: now 1786337498925929 us; error 71 us; skew 500 ppm
I20260810 04:51:38.927644 32068 webserver.cc:460] Webserver started at http://127.15.239.194:33853/ using document root <none> and password file <none>
I20260810 04:51:38.927935 32068 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:38.928009 32068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:38.928223 32068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:38.929522 32068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "9cdef4452a934982b04514f9d434ae1e"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "3ff6124904b8b37ae9f660f9b16cf560"
server_key_iv: "e8ae7a16dcbbd8884e5cb460b21bace4"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.929939 32068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "9cdef4452a934982b04514f9d434ae1e"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "3ff6124904b8b37ae9f660f9b16cf560"
server_key_iv: "e8ae7a16dcbbd8884e5cb460b21bace4"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.931499 32068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:51:38.932405 32085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.932634 32068 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:38.932789 32068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "9cdef4452a934982b04514f9d434ae1e"
format_stamp: "Formatted at 2026-08-10 04:51:38 on dist-test-slave-kvfs"
server_key: "3ff6124904b8b37ae9f660f9b16cf560"
server_key_iv: "e8ae7a16dcbbd8884e5cb460b21bace4"
server_key_version: "encryptionkey@0"
I20260810 04:51:38.932885 32068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:38.936821 32068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:38.937134 32068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:38.937287 32068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:38.937525 32068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:38.937913 32068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:38.937973 32068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.938015 32068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:38.938042 32068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:38.945107 32068 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:33017
I20260810 04:51:38.945163 32262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:33017 every 8 connection(s)
I20260810 04:51:38.945562 32068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:38.949481 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.946558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:49421 (local address 127.15.239.254:44603)
0810 04:51:38.946648 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:38.946650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:38.946973 (+ 323us) server_negotiation.cc:407] Connection header received
0810 04:51:38.947614 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:38.947616 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:38.947624 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:38.947686 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:38.949164 (+ 1478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:38.949166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:38.949166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:38.949172 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:38.949193 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:38.949199 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:38.949268 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:38.949383 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 04:51:38.949402 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 04:51:38.949651 32269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:38.946510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44603 (local address 127.15.239.194:49421)
0810 04:51:38.946816 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:38.946861 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:38.947471 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:38.947760 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:38.947764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:38.947782 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:38.948917 (+ 1135us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:38.948918 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:38.948953 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:38.948993 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:38.949268 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:38.949271 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:38.949274 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:38.949342 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:51:38.949405 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":120,"threads_started":1}
I20260810 04:51:38.950253 32267 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44603
I20260810 04:51:38.950392 32267 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:38.950572 32267 heartbeater.cc:511] Master 127.15.239.254:44603 requested a full tablet report, sending...
I20260810 04:51:38.951076 31787 ts_manager.cc:194] Registered new tserver with Master: 9cdef4452a934982b04514f9d434ae1e (127.15.239.194:33017)
I20260810 04:51:38.955849 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 32068
I20260810 04:51:38.955956 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:38.956241 16319 external_mini_cluster.cc:1428] Setting key 15dc38632e929950c3dc4ad39b46df4a
I20260810 04:51:38.957324 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44603
--builtin_ntp_servers=127.15.239.212:35037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 04:51:39.057751 32270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:39.058029 32270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:39.058054 32270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:39.059218 32270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:39.059260 32270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:39.059286 32270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:39.060777 32270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:39.061054 32270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:39.061381 32270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:39.067301 32280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:39.067353 32278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:39.067549 32270 server_base.cc:1034] running on GCE node
W20260810 04:51:39.067327 32283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:39.067904 32270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:39.068225 32270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:39.069408 32270 hybrid_clock.cc:648] HybridClock initialized: now 1786337499069395 us; error 49 us; skew 500 ppm
I20260810 04:51:39.070916 32270 webserver.cc:460] Webserver started at http://127.15.239.195:36967/ using document root <none> and password file <none>
I20260810 04:51:39.071237 32270 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:39.071316 32270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:39.071491 32270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:39.072842 32270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "7a9c928103284045b778217d9e2d1cf8"
format_stamp: "Formatted at 2026-08-10 04:51:39 on dist-test-slave-kvfs"
server_key: "002ecd608f9e595d9154e265f63d2ae4"
server_key_iv: "ae785541bc409d99d8f5cf92056d1bc6"
server_key_version: "encryptionkey@0"
I20260810 04:51:39.073289 32270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "7a9c928103284045b778217d9e2d1cf8"
format_stamp: "Formatted at 2026-08-10 04:51:39 on dist-test-slave-kvfs"
server_key: "002ecd608f9e595d9154e265f63d2ae4"
server_key_iv: "ae785541bc409d99d8f5cf92056d1bc6"
server_key_version: "encryptionkey@0"
I20260810 04:51:39.075135 32270 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 04:51:39.076131 32290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:39.076411 32270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:39.076550 32270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "7a9c928103284045b778217d9e2d1cf8"
format_stamp: "Formatted at 2026-08-10 04:51:39 on dist-test-slave-kvfs"
server_key: "002ecd608f9e595d9154e265f63d2ae4"
server_key_iv: "ae785541bc409d99d8f5cf92056d1bc6"
server_key_version: "encryptionkey@0"
I20260810 04:51:39.076644 32270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:39.080552 32270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:39.080876 32270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:39.081035 32270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:39.081280 32270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:39.081651 32270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:39.081708 32270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:39.081751 32270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:39.081779 32270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:39.088701 32270 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:39439
I20260810 04:51:39.088742 32462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:39439 every 8 connection(s)
I20260810 04:51:39.089139 32270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:39.092667 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:39.090084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:60227 (local address 127.15.239.254:44603)
0810 04:51:39.090165 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:39.090168 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:39.090423 (+ 255us) server_negotiation.cc:407] Connection header received
0810 04:51:39.090985 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:39.090986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:39.090993 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:39.091063 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:39.092409 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:39.092412 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:39.092412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:51:39.092417 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:39.092436 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:51:39.092441 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:39.092496 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:39.092580 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 04:51:39.092597 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:51:39.092897 32465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:39.090055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44603 (local address 127.15.239.195:60227)
0810 04:51:39.090271 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:39.090319 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:39.090881 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:39.091128 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:39.091132 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:39.091141 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:39.092236 (+ 1095us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:51:39.092237 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:39.092271 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:51:39.092303 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:39.092507 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:39.092512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:39.092515 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:51:39.092579 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 04:51:39.092637 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260810 04:51:39.093521 32463 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44603
I20260810 04:51:39.093637 32463 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:39.093832 32463 heartbeater.cc:511] Master 127.15.239.254:44603 requested a full tablet report, sending...
I20260810 04:51:39.094331 31787 ts_manager.cc:194] Registered new tserver with Master: 7a9c928103284045b778217d9e2d1cf8 (127.15.239.195:39439)
I20260810 04:51:39.095235 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 32270
I20260810 04:51:39.095356 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:39.095615 16319 external_mini_cluster.cc:1428] Setting key 2a04e74aa5b47377bb7ec84fdc1700ce
I20260810 04:51:39.096712 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 04:51:39.099133 31849 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:51:39.098425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44306 (local address 127.15.239.254:44603)
0810 04:51:39.098488 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:39.098489 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:39.098654 (+ 165us) server_negotiation.cc:407] Connection header received
0810 04:51:39.098708 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:39.098708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:39.098713 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:39.098770 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:39.099023 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44306: BlockingRecv error: recv got EOF from 127.0.0.1:44306 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:51:39.099493 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 31877
I20260810 04:51:39.113886 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 32068
I20260810 04:51:39.141181 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 32270
I20260810 04:51:39.153371 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 31738
2026-08-10T04:51:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (702 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:39 dist-test-slave-kvfs krb5kdc[32477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:39 dist-test-slave-kvfs krb5kdc[32477](info): set up 2 sockets
Aug 10 04:51:39 dist-test-slave-kvfs krb5kdc[32477](info): commencing operation
krb5kdc: starting...
W20260810 04:51:40.444973 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:40 dist-test-slave-kvfs krb5kdc[32477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:51:40.588249 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44155
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:44155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:40.686210 32498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:40.686524 32498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:40.686565 32498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:40.687832 32498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:51:40.687908 32498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:40.687932 32498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:40.687954 32498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:51:40.687986 32498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:51:40.689637 32498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:44155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:40.689985 32498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:40.690269 32498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:40.696091 32503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:40.696096 32509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:40.696096 32504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:40.696421 32498 server_base.cc:1034] running on GCE node
I20260810 04:51:40.696795 32498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:40.697166 32498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:40.698347 32498 hybrid_clock.cc:648] HybridClock initialized: now 1786337500698335 us; error 41 us; skew 500 ppm
Aug 10 04:51:40 dist-test-slave-kvfs krb5kdc[32477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337500, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:40.705706 32498 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:51:40.706282 32498 webserver.cc:460] Webserver started at http://127.15.239.254:42343/ using document root <none> and password file <none>
I20260810 04:51:40.706537 32498 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:40.706594 32498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:40.706707 32498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:40.707965 32498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "72fd160f61d94bbb90c3119ff781743a"
format_stamp: "Formatted at 2026-08-10 04:51:40 on dist-test-slave-kvfs"
server_key: "3bc272ac29c096e7f204ea7f4af1fe0d"
server_key_iv: "3a89efd438983e7fe0ed6adfac84486d"
server_key_version: "encryptionkey@0"
I20260810 04:51:40.708422 32498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "72fd160f61d94bbb90c3119ff781743a"
format_stamp: "Formatted at 2026-08-10 04:51:40 on dist-test-slave-kvfs"
server_key: "3bc272ac29c096e7f204ea7f4af1fe0d"
server_key_iv: "3a89efd438983e7fe0ed6adfac84486d"
server_key_version: "encryptionkey@0"
I20260810 04:51:40.709986 32498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:51:40.710891 32518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:40.711117 32498 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:40.711226 32498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "72fd160f61d94bbb90c3119ff781743a"
format_stamp: "Formatted at 2026-08-10 04:51:40 on dist-test-slave-kvfs"
server_key: "3bc272ac29c096e7f204ea7f4af1fe0d"
server_key_iv: "3a89efd438983e7fe0ed6adfac84486d"
server_key_version: "encryptionkey@0"
I20260810 04:51:40.711290 32498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:40.731226 32498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:40.734498 32498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:40.734710 32498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:40.739758 32498 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:44155
I20260810 04:51:40.739794 32601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:44155 every 8 connection(s)
I20260810 04:51:40.740288 32498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:51:40.741529 32602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:40.744457 32602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a: Bootstrap starting.
I20260810 04:51:40.745204 32602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:40.745569 32602 log.cc:824] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:40.746451 32602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a: No bootstrap required, opened a new log
I20260810 04:51:40.746438 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 32498
I20260810 04:51:40.746587 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:51:40.746825 16319 external_mini_cluster.cc:1428] Setting key 11e8588603eabccdd82ec05560dbd427
I20260810 04:51:40.749078 32602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fd160f61d94bbb90c3119ff781743a" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44155 } }
I20260810 04:51:40.749322 32602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:40.749363 32602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72fd160f61d94bbb90c3119ff781743a, State: Initialized, Role: FOLLOWER
I20260810 04:51:40.749529 32602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fd160f61d94bbb90c3119ff781743a" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44155 } }
I20260810 04:51:40.749632 32602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:51:40.749670 32602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:51:40.749790 32602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:40.750509 32602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fd160f61d94bbb90c3119ff781743a" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44155 } }
I20260810 04:51:40.750639 32602 leader_election.cc:302] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72fd160f61d94bbb90c3119ff781743a; no voters:
I20260810 04:51:40.750809 32602 leader_election.cc:288] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:51:40.750886 32611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:40.751119 32602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:51:40.751119 32611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [term 1 LEADER]: Becoming Leader. State: Replica: 72fd160f61d94bbb90c3119ff781743a, State: Running, Role: LEADER
I20260810 04:51:40.751473 32611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fd160f61d94bbb90c3119ff781743a" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44155 } }
I20260810 04:51:40.751940 32615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72fd160f61d94bbb90c3119ff781743a. Latest consensus state: current_term: 1 leader_uuid: "72fd160f61d94bbb90c3119ff781743a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fd160f61d94bbb90c3119ff781743a" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44155 } } }
I20260810 04:51:40.752045 32615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:40.752211 32613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72fd160f61d94bbb90c3119ff781743a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72fd160f61d94bbb90c3119ff781743a" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44155 } } }
I20260810 04:51:40.752279 32613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a [sys.catalog]: This master's current role is: LEADER
I20260810 04:51:40.752429 32624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:51:40.753073 32624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:51:40.755594 32624 catalog_manager.cc:1347] Generated new cluster ID: bcfd80e3c0ea47c89ace7a25fa7737ae
I20260810 04:51:40.755658 32624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:51:40 dist-test-slave-kvfs krb5kdc[32477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:40.761432 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:40.747556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.15.239.254:44155)
0810 04:51:40.747800 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:40.747812 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:40.747850 (+ 38us) server_negotiation.cc:407] Connection header received
0810 04:51:40.749342 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:40.749354 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:40.749434 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:40.749611 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:40.750420 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:40.751988 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:40.753259 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:40.753914 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:40.754043 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:40.757342 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:40.757347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:40.757348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:40.757372 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:40.759472 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:40.759931 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:40.759935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:40.759935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:40.760120 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:40.760376 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:40.760377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:40.760377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:40.760692 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:40.760891 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:40.761034 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 04:51:40.761215 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":101,"threads_started":1}
I20260810 04:51:40.763316 32624 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:51:40.764084 32624 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:51:40.770627 32624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a: Generated new TSK 0
I20260810 04:51:40.770851 32624 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:51:40.811893 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44155
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:40.919456 32643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:40.919757 32643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:40.919798 32643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:40.921219 32643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:40.921276 32643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:40.921308 32643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:51:40.922977 32643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:40.923233 32643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:40.923482 32643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:40.929839 32650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:40.929862 32649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:40.929839 32655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:40.930333 32643 server_base.cc:1034] running on GCE node
I20260810 04:51:40.930608 32643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:40.930918 32643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:40.932133 32643 hybrid_clock.cc:648] HybridClock initialized: now 1786337500932109 us; error 43 us; skew 500 ppm
Aug 10 04:51:40 dist-test-slave-kvfs krb5kdc[32477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337500, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:40.935343 32643 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:51:40.935946 32643 webserver.cc:460] Webserver started at http://127.15.239.193:42857/ using document root <none> and password file <none>
I20260810 04:51:40.936286 32643 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:40.936370 32643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:40.936558 32643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:40.937860 32643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "9c4ffab14eb5476a95bac2c434190458"
format_stamp: "Formatted at 2026-08-10 04:51:40 on dist-test-slave-kvfs"
server_key: "c3e2170ac709c7c412ff01dc604f05c4"
server_key_iv: "c2955409a00865339ff349e88e6c200f"
server_key_version: "encryptionkey@0"
I20260810 04:51:40.938292 32643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "9c4ffab14eb5476a95bac2c434190458"
format_stamp: "Formatted at 2026-08-10 04:51:40 on dist-test-slave-kvfs"
server_key: "c3e2170ac709c7c412ff01dc604f05c4"
server_key_iv: "c2955409a00865339ff349e88e6c200f"
server_key_version: "encryptionkey@0"
I20260810 04:51:40.939930 32643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:40.940950 32666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:40.941210 32643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:40.941331 32643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "9c4ffab14eb5476a95bac2c434190458"
format_stamp: "Formatted at 2026-08-10 04:51:40 on dist-test-slave-kvfs"
server_key: "c3e2170ac709c7c412ff01dc604f05c4"
server_key_iv: "c2955409a00865339ff349e88e6c200f"
server_key_version: "encryptionkey@0"
I20260810 04:51:40.941421 32643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:40.957803 32643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:40.960510 32643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:40.960711 32643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:40.961035 32643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:40.961424 32643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:40.961486 32643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:40.961534 32643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:40.961581 32643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:40.969053 32643 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:43847
I20260810 04:51:40.969094 379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:43847 every 8 connection(s)
I20260810 04:51:40.969532 32643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:51:40.971236 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 32643
I20260810 04:51:40.971396 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:51:40.971686 16319 external_mini_cluster.cc:1428] Setting key e9c83d20ed23edee38d52bf64a652fee
Aug 10 04:51:40 dist-test-slave-kvfs krb5kdc[32477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337500, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:40.982493 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:40.970615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:47489 (local address 127.15.239.254:44155)
0810 04:51:40.970702 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:40.970704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:40.970885 (+ 181us) server_negotiation.cc:407] Connection header received
0810 04:51:40.971641 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:40.971644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:40.971664 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:40.971758 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:40.973543 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:40.974398 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:40.975561 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:40.975927 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:40.976010 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:40.979017 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:40.979018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:40.979019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:40.979030 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:40.980888 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:40.981357 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:40.981358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:40.981359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:40.981427 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:40.981712 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:40.981713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:40.981713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:40.981852 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:40.981933 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:40.982251 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 04:51:40.982368 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:51:40.982717 382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:40.970508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44155 (local address 127.15.239.193:47489)
0810 04:51:40.970715 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:40.970769 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:40.971494 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:40.971873 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:40.971879 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:40.972928 (+ 1049us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:40.973368 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:40.973376 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:40.974519 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:40.974520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:40.975452 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:40.975455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:40.976068 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:40.976070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:40.976257 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:40.976955 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:40.976967 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:40.978893 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:40.980985 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:40.980994 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:40.980998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:40.981263 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:40.981505 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:40.981506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:40.981506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:40.981640 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:40.981924 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:40.981932 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:40.982107 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 04:51:40.982230 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:51:40.982424 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":121,"threads_started":1}
I20260810 04:51:40.983400 380 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44155
I20260810 04:51:40.983554 380 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:40.983824 380 heartbeater.cc:511] Master 127.15.239.254:44155 requested a full tablet report, sending...
I20260810 04:51:40.984637 32542 ts_manager.cc:194] Registered new tserver with Master: 9c4ffab14eb5476a95bac2c434190458 (127.15.239.193:43847)
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
I20260810 04:51:40.985520 32542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:47489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:51:41.008437 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44155
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:41.105098 387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:41.105356 387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:41.105383 387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:41.106669 387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:41.106715 387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:41.106745 387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:51:41.108462 387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:41.108764 387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:41.109058 387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:41.115195 400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:41.115226 396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:41.115195 398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:41.115556 387 server_base.cc:1034] running on GCE node
I20260810 04:51:41.115785 387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:41.116134 387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:41.117308 387 hybrid_clock.cc:648] HybridClock initialized: now 1786337501117291 us; error 31 us; skew 500 ppm
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[32477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337501, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:41.120370 387 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:51:41.120951 387 webserver.cc:460] Webserver started at http://127.15.239.194:45957/ using document root <none> and password file <none>
I20260810 04:51:41.121270 387 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:41.121354 387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:41.121538 387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:41.122869 387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "c915a935bd0c45948879cad0e939b19f"
format_stamp: "Formatted at 2026-08-10 04:51:41 on dist-test-slave-kvfs"
server_key: "67a311b6c63158129226f28ef2abed1f"
server_key_iv: "db9e5b0762839af19baacca3f843f428"
server_key_version: "encryptionkey@0"
I20260810 04:51:41.123320 387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "c915a935bd0c45948879cad0e939b19f"
format_stamp: "Formatted at 2026-08-10 04:51:41 on dist-test-slave-kvfs"
server_key: "67a311b6c63158129226f28ef2abed1f"
server_key_iv: "db9e5b0762839af19baacca3f843f428"
server_key_version: "encryptionkey@0"
I20260810 04:51:41.125082 387 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 04:51:41.125985 407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:41.126262 387 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:51:41.126433 387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c915a935bd0c45948879cad0e939b19f"
format_stamp: "Formatted at 2026-08-10 04:51:41 on dist-test-slave-kvfs"
server_key: "67a311b6c63158129226f28ef2abed1f"
server_key_iv: "db9e5b0762839af19baacca3f843f428"
server_key_version: "encryptionkey@0"
I20260810 04:51:41.126528 387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:41.134658 387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:41.137085 387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:41.137280 387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:41.137566 387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:41.137931 387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:41.137995 387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:41.138032 387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:41.138078 387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:41.145289 387 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:36227
I20260810 04:51:41.145334 579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:36227 every 8 connection(s)
I20260810 04:51:41.145787 387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:51:41.146246 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 387
I20260810 04:51:41.146360 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:51:41.146608 16319 external_mini_cluster.cc:1428] Setting key 4d893b9cec1b7238b80cd8a4d881c735
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[32477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337501, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:41.158440 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.146799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:43639 (local address 127.15.239.254:44155)
0810 04:51:41.146874 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.146878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.147364 (+ 486us) server_negotiation.cc:407] Connection header received
0810 04:51:41.148053 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.148056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.148071 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.148144 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:41.149296 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.150115 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.151797 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.152143 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.152228 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.154907 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:41.154909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:41.154910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:41.154930 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:41.156869 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:41.157303 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:41.157305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:41.157305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:41.157384 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:41.157647 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:41.157648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:41.157648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:41.157823 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:41.157892 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.158204 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.158302 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:51:41.158634 582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.146713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44155 (local address 127.15.239.194:43639)
0810 04:51:41.146920 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.146973 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.147910 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.148220 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.148225 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.148937 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:41.149192 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.149197 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.150236 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.150238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.151677 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.151681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.152240 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.152242 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.152419 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.153134 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:41.153146 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:41.154794 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:41.156967 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:41.156975 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:41.156978 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:41.157222 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:41.157468 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:41.157469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:41.157470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:41.157580 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:41.157899 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:41.157904 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:41.158052 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.158142 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.158292 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
I20260810 04:51:41.159297 580 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44155
I20260810 04:51:41.159446 580 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:41.159715 580 heartbeater.cc:511] Master 127.15.239.254:44155 requested a full tablet report, sending...
I20260810 04:51:41.160274 32542 ts_manager.cc:194] Registered new tserver with Master: c915a935bd0c45948879cad0e939b19f (127.15.239.194:36227)
I20260810 04:51:41.160722 32542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:43639
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:51:41.179858 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44155
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:35971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:51:41.282768 588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:51:41.283049 588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:51:41.283075 588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:51:41.284333 588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:51:41.284384 588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:51:41.284412 588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:51:41.285949 588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:35971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:51:41.286194 588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:51:41.286441 588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:51:41.292801 596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:41.292814 597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:51:41.292814 599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:51:41.293017 588 server_base.cc:1034] running on GCE node
I20260810 04:51:41.293393 588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:51:41.293691 588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:51:41.294842 588 hybrid_clock.cc:648] HybridClock initialized: now 1786337501294798 us; error 71 us; skew 500 ppm
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[32477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337501, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:51:41.298719 588 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:51:41.299425 588 webserver.cc:460] Webserver started at http://127.15.239.195:42015/ using document root <none> and password file <none>
I20260810 04:51:41.299773 588 fs_manager.cc:359] Metadata directory not provided
I20260810 04:51:41.299856 588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:51:41.300046 588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:51:41.301460 588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "906ab4af92f049b4b23396fab260935a"
format_stamp: "Formatted at 2026-08-10 04:51:41 on dist-test-slave-kvfs"
server_key: "31e5246fb25523051cc435674c7f340d"
server_key_iv: "fc8138fc8c9b604950563a21f6fb96f1"
server_key_version: "encryptionkey@0"
I20260810 04:51:41.301913 588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "906ab4af92f049b4b23396fab260935a"
format_stamp: "Formatted at 2026-08-10 04:51:41 on dist-test-slave-kvfs"
server_key: "31e5246fb25523051cc435674c7f340d"
server_key_iv: "fc8138fc8c9b604950563a21f6fb96f1"
server_key_version: "encryptionkey@0"
I20260810 04:51:41.303457 588 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:51:41.304350 609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:41.304577 588 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:51:41.304720 588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "906ab4af92f049b4b23396fab260935a"
format_stamp: "Formatted at 2026-08-10 04:51:41 on dist-test-slave-kvfs"
server_key: "31e5246fb25523051cc435674c7f340d"
server_key_iv: "fc8138fc8c9b604950563a21f6fb96f1"
server_key_version: "encryptionkey@0"
I20260810 04:51:41.304842 588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:51:41.323345 588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:51:41.326270 588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:51:41.326450 588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:51:41.326756 588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:51:41.327165 588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:51:41.327222 588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:41.327270 588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:51:41.327301 588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:51:41.334590 588 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:32801
I20260810 04:51:41.334676 775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:32801 every 8 connection(s)
I20260810 04:51:41.335096 588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:51:41.337592 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 588
I20260810 04:51:41.337738 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:51:41.337981 16319 external_mini_cluster.cc:1428] Setting key 1bcf0e45987f092f36ee1f4d66551e27
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[32477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337501, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:51:41.346635 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.336125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:46167 (local address 127.15.239.254:44155)
0810 04:51:41.336196 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.336199 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.336515 (+ 316us) server_negotiation.cc:407] Connection header received
0810 04:51:41.337128 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.337131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.337144 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.337202 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:41.338721 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.339405 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.340691 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.340897 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.340957 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.343525 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:41.343526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:41.343527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:41.343534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:41.345197 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:41.345693 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:41.345694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:41.345695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:41.345753 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:41.346035 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:41.346036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:41.346036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:41.346153 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:41.346208 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.346486 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.346553 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:51:41.346930 778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.336103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44155 (local address 127.15.239.195:46167)
0810 04:51:41.336336 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.336400 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.337023 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.337272 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.337276 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.338251 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:51:41.338599 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.338607 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.339563 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.339564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.340601 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.340604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.340977 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.340978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.341096 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.341747 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:51:41.341757 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:51:41.343420 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:51:41.345275 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:41.345282 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:41.345284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:41.345618 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:41.345817 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:51:41.345818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:51:41.345818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:51:41.345977 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:51:41.346211 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:51:41.346217 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:51:41.346365 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.346463 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.346621 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":124,"threads_started":1}
I20260810 04:51:41.347532 776 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44155
I20260810 04:51:41.347671 776 heartbeater.cc:464] Registering TS with master...
I20260810 04:51:41.347904 776 heartbeater.cc:511] Master 127.15.239.254:44155 requested a full tablet report, sending...
I20260810 04:51:41.348441 32542 ts_manager.cc:194] Registered new tserver with Master: 906ab4af92f049b4b23396fab260935a (127.15.239.195:32801)
I20260810 04:51:41.348891 32542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:46167
I20260810 04:51:41.350117 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:51:41.359019 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.351890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51292 (local address 127.15.239.254:44155)
0810 04:51:41.351957 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.351959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.352151 (+ 192us) server_negotiation.cc:407] Connection header received
0810 04:51:41.352241 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.352242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.352254 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.352321 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:51:41.353041 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.353600 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.354450 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.354683 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.354777 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.356100 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:51:41.356102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:51:41.356102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:51:41.356109 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:51:41.357601 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:41.358037 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:41.358038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:41.358039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:41.358115 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:51:41.358364 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:51:41.358365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:51:41.358365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:51:41.358564 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:51:41.358698 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.358809 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.358903 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:51:41.360944 32542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:51:41.362874 32542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:51:41.371222 793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.366204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50558 (local address 127.15.239.195:32801)
0810 04:51:41.366507 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.366513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.366672 (+ 159us) server_negotiation.cc:407] Connection header received
0810 04:51:41.366828 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.366831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.366854 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.366958 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:41.367159 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.368754 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.370065 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.370745 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.370825 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.370878 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.371074 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.371115 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":111,"threads_started":1}
I20260810 04:51:41.371210 790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.365954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36227 (local address 127.0.0.1:48752)
0810 04:51:41.366412 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.366469 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.366846 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.367185 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.367185 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.367186 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:41.367224 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.367225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.368586 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.368588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.369735 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.369739 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.370827 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.370829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.370922 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.370939 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.371026 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.371112 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":2,"thread_start_us":79,"threads_started":1}
I20260810 04:51:41.371259 795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.366240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.15.239.194:36227)
0810 04:51:41.366628 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.366633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.366647 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:51:41.366978 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.366981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.366999 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.367064 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:41.367309 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.368468 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.369843 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.370630 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.370711 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.370788 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.371049 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.371110 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":116,"threads_started":1}
I20260810 04:51:41.371605 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.365963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:43847 (local address 127.0.0.1:45078)
0810 04:51:41.366826 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.366835 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.366892 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.367171 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.367172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.367174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:41.367223 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.367225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.369236 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.369245 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.370249 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.370252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.371323 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.371325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.371400 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.371406 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.371462 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.371514 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"thread_start_us":140,"threads_started":1}
I20260810 04:51:41.371614 791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.365954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:32801 (local address 127.0.0.1:50558)
0810 04:51:41.366601 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.366612 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.366699 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.366981 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.366985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.366987 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:41.367080 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.367083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.368878 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.368880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.369961 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.369964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.370911 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.370912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.370976 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.370980 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.371025 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.371535 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":395,"thread_start_us":127,"threads_started":1}
I20260810 04:51:41.372010 796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.366604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45078 (local address 127.15.239.193:43847)
0810 04:51:41.366848 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.366853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.366890 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:51:41.366967 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.366970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.366988 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.367077 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:41.368128 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.369109 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.370355 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.371139 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.371221 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.371278 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.371832 (+ 554us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.371892 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":112,"threads_started":1}
I20260810 04:51:41.372478 678 tablet_service.cc:1467] Processing CreateTablet for tablet cdb691d0971b40be98e709c21adad1da (DEFAULT_TABLE table=test-table [id=22e8f49421574635a26da2baedacbfff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:41.372495 490 tablet_service.cc:1467] Processing CreateTablet for tablet cdb691d0971b40be98e709c21adad1da (DEFAULT_TABLE table=test-table [id=22e8f49421574635a26da2baedacbfff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:41.372673 32734 tablet_service.cc:1467] Processing CreateTablet for tablet cdb691d0971b40be98e709c21adad1da (DEFAULT_TABLE table=test-table [id=22e8f49421574635a26da2baedacbfff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:51:41.372869 678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb691d0971b40be98e709c21adad1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:41.372884 490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb691d0971b40be98e709c21adad1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:41.373023 32734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb691d0971b40be98e709c21adad1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:51:41.376356 797 tablet_bootstrap.cc:492] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Bootstrap starting.
I20260810 04:51:41.376971 798 tablet_bootstrap.cc:492] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Bootstrap starting.
I20260810 04:51:41.377490 797 tablet_bootstrap.cc:654] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:41.377696 798 tablet_bootstrap.cc:654] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:41.378247 797 log.cc:824] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:41.378356 798 log.cc:824] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:41.378705 799 tablet_bootstrap.cc:492] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: Bootstrap starting.
I20260810 04:51:41.379209 797 tablet_bootstrap.cc:492] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: No bootstrap required, opened a new log
I20260810 04:51:41.379243 798 tablet_bootstrap.cc:492] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: No bootstrap required, opened a new log
I20260810 04:51:41.379308 798 ts_tablet_manager.cc:1397] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:51:41.379310 797 ts_tablet_manager.cc:1397] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:51:41.379482 799 tablet_bootstrap.cc:654] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: Neither blocks nor log segments found. Creating new log.
I20260810 04:51:41.380205 799 log.cc:824] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: Log is configured to *not* fsync() on all Append() calls
I20260810 04:51:41.381316 799 tablet_bootstrap.cc:492] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: No bootstrap required, opened a new log
I20260810 04:51:41.381409 799 ts_tablet_manager.cc:1397] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:51:41.381541 797 raft_consensus.cc:348] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.381754 797 raft_consensus.cc:374] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:41.381806 797 raft_consensus.cc:729] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906ab4af92f049b4b23396fab260935a, State: Initialized, Role: FOLLOWER
I20260810 04:51:41.381812 798 raft_consensus.cc:348] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.381971 797 consensus_queue.cc:260] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.382048 798 raft_consensus.cc:374] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:41.382084 798 raft_consensus.cc:729] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c915a935bd0c45948879cad0e939b19f, State: Initialized, Role: FOLLOWER
I20260810 04:51:41.382236 798 consensus_queue.cc:260] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.382331 776 heartbeater.cc:503] Master 127.15.239.254:44155 was elected leader, sending a full tablet report...
I20260810 04:51:41.382544 798 ts_tablet_manager.cc:1428] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:51:41.382571 580 heartbeater.cc:503] Master 127.15.239.254:44155 was elected leader, sending a full tablet report...
I20260810 04:51:41.382725 797 ts_tablet_manager.cc:1428] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:51:41.383658 799 raft_consensus.cc:348] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.383827 799 raft_consensus.cc:374] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:51:41.383867 799 raft_consensus.cc:729] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4ffab14eb5476a95bac2c434190458, State: Initialized, Role: FOLLOWER
I20260810 04:51:41.383996 799 consensus_queue.cc:260] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.384356 799 ts_tablet_manager.cc:1428] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260810 04:51:41.384390 380 heartbeater.cc:503] Master 127.15.239.254:44155 was elected leader, sending a full tablet report...
W20260810 04:51:41.396534 581 tablet.cc:2369] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:51:41.432413 807 raft_consensus.cc:482] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:51:41.432603 807 raft_consensus.cc:504] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.433092 807 leader_election.cc:288] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 906ab4af92f049b4b23396fab260935a (127.15.239.195:32801), c915a935bd0c45948879cad0e939b19f (127.15.239.194:36227)
I20260810 04:51:41.437463 793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.433437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:54427 (local address 127.15.239.195:32801)
0810 04:51:41.433503 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.433505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.433668 (+ 163us) server_negotiation.cc:407] Connection header received
0810 04:51:41.433710 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.433712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.433720 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.433765 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:41.433939 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.434692 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.436448 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.437064 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.437150 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.437161 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.437329 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.437378 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:51:41.437459 795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.433376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:37855 (local address 127.15.239.194:36227)
0810 04:51:41.433436 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.433438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.433454 (+ 16us) server_negotiation.cc:407] Connection header received
0810 04:51:41.433499 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.433500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.433515 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.433589 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:51:41.433841 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.434697 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.436443 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.437078 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.437150 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.437161 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.437330 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.437372 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:51:41.437472 382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.433292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36227 (local address 127.15.239.193:37855)
0810 04:51:41.433362 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.433376 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.433428 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.433624 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.433626 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.433628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:41.433731 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.433733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.434787 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.434788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.436349 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.436351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.437157 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.437158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.437248 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.437250 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.437304 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.437361 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":138}
I20260810 04:51:41.437479 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.433305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:32801 (local address 127.15.239.193:54427)
0810 04:51:41.433556 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.433585 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0810 04:51:41.433641 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:51:41.433794 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:51:41.433795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:51:41.433797 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:51:41.433870 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.433871 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.434787 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.434788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.436347 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:51:41.436351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.437157 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.437158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:51:41.437241 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.437246 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:51:41.437304 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:51:41.437361 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":109,"thread_start_us":193,"threads_started":1}
I20260810 04:51:41.437955 515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb691d0971b40be98e709c21adad1da" candidate_uuid: "9c4ffab14eb5476a95bac2c434190458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915a935bd0c45948879cad0e939b19f" is_pre_election: true
I20260810 04:51:41.437968 716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb691d0971b40be98e709c21adad1da" candidate_uuid: "9c4ffab14eb5476a95bac2c434190458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906ab4af92f049b4b23396fab260935a" is_pre_election: true
I20260810 04:51:41.438172 716 raft_consensus.cc:2454] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4ffab14eb5476a95bac2c434190458 in term 0.
I20260810 04:51:41.438172 515 raft_consensus.cc:2454] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4ffab14eb5476a95bac2c434190458 in term 0.
I20260810 04:51:41.438467 32668 leader_election.cc:302] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 906ab4af92f049b4b23396fab260935a, 9c4ffab14eb5476a95bac2c434190458; no voters:
I20260810 04:51:41.438660 807 raft_consensus.cc:2781] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:51:41.438731 807 raft_consensus.cc:482] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:51:41.438750 807 raft_consensus.cc:3037] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:41.439787 807 raft_consensus.cc:504] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.439942 807 leader_election.cc:288] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [CANDIDATE]: Term 1 election: Requested vote from peers 906ab4af92f049b4b23396fab260935a (127.15.239.195:32801), c915a935bd0c45948879cad0e939b19f (127.15.239.194:36227)
I20260810 04:51:41.440111 716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb691d0971b40be98e709c21adad1da" candidate_uuid: "9c4ffab14eb5476a95bac2c434190458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "906ab4af92f049b4b23396fab260935a"
I20260810 04:51:41.440133 515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb691d0971b40be98e709c21adad1da" candidate_uuid: "9c4ffab14eb5476a95bac2c434190458" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c915a935bd0c45948879cad0e939b19f"
I20260810 04:51:41.440212 716 raft_consensus.cc:3037] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:41.440210 515 raft_consensus.cc:3037] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:51:41.441473 716 raft_consensus.cc:2454] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4ffab14eb5476a95bac2c434190458 in term 1.
I20260810 04:51:41.441473 515 raft_consensus.cc:2454] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4ffab14eb5476a95bac2c434190458 in term 1.
I20260810 04:51:41.441681 32668 leader_election.cc:302] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 906ab4af92f049b4b23396fab260935a, 9c4ffab14eb5476a95bac2c434190458; no voters:
I20260810 04:51:41.441785 807 raft_consensus.cc:2781] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:51:41.441937 807 raft_consensus.cc:686] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 1 LEADER]: Becoming Leader. State: Replica: 9c4ffab14eb5476a95bac2c434190458, State: Running, Role: LEADER
I20260810 04:51:41.442067 807 consensus_queue.cc:237] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } }
I20260810 04:51:41.443156 32541 catalog_manager.cc:5495] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c4ffab14eb5476a95bac2c434190458 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "9c4ffab14eb5476a95bac2c434190458" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c4ffab14eb5476a95bac2c434190458" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 43847 } health_report { overall_health: HEALTHY } } }
I20260810 04:51:41.463157 796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.460574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45088 (local address 127.15.239.193:43847)
0810 04:51:41.460640 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:51:41.460642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:51:41.460653 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:51:41.460700 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:51:41.460701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:51:41.460723 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:51:41.460811 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:51:41.461024 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.461555 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.462365 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:51:41.462573 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:51:41.462631 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:51:41.462792 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:51:41.462921 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:51:41.462994 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:51:41.463062 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 04:51:41.463083 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:51:41.465497 716 raft_consensus.cc:1261] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 1 FOLLOWER]: Refusing update from remote peer 9c4ffab14eb5476a95bac2c434190458: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:41.465497 515 raft_consensus.cc:1261] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 1 FOLLOWER]: Refusing update from remote peer 9c4ffab14eb5476a95bac2c434190458: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:51:41.465919 807 consensus_queue.cc:1035] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c915a935bd0c45948879cad0e939b19f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:41.466104 810 consensus_queue.cc:1035] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [LEADER]: Connected to new peer: Peer: permanent_uuid: "906ab4af92f049b4b23396fab260935a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 32801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:51:41.469622 815 mvcc.cc:205] Tried to move back new op lower bound from 7316838405999329280 to 7316838405907398656. Current Snapshot: MvccSnapshot[applied={T|T < 7316838405999329280}]
I20260810 04:51:41.469940 813 mvcc.cc:205] Tried to move back new op lower bound from 7316838405999329280 to 7316838405907398656. Current Snapshot: MvccSnapshot[applied={T|T < 7316838405999329280 or (T in {7316838405999329280})}]
I20260810 04:51:41.471740 32541 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:41.471853 32541 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:51:41.472906 32541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72fd160f61d94bbb90c3119ff781743a: Sending DeleteTablet for 3 replicas of tablet cdb691d0971b40be98e709c21adad1da
I20260810 04:51:41.473331 678 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb691d0971b40be98e709c21adad1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:41 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:50558
I20260810 04:51:41.473330 490 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb691d0971b40be98e709c21adad1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:41 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:48752
I20260810 04:51:41.473593 828 tablet_replica.cc:330] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: stopping tablet replica
I20260810 04:51:41.473714 828 raft_consensus.cc:2229] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:41.473793 32734 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb691d0971b40be98e709c21adad1da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:51:41 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:45078
I20260810 04:51:41.473845 828 raft_consensus.cc:2258] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:41.474058 832 tablet_replica.cc:330] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458: stopping tablet replica
I20260810 04:51:41.474205 832 raft_consensus.cc:2229] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:51:41.474237 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 32643
I20260810 04:51:41.474382 828 ts_tablet_manager.cc:1905] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:41.474402 832 raft_consensus.cc:2258] T cdb691d0971b40be98e709c21adad1da P 9c4ffab14eb5476a95bac2c434190458 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:41.476701 828 ts_tablet_manager.cc:1918] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:41.476778 828 log.cc:1196] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/cdb691d0971b40be98e709c21adad1da
I20260810 04:51:41.477039 828 ts_tablet_manager.cc:1939] T cdb691d0971b40be98e709c21adad1da P c915a935bd0c45948879cad0e939b19f: Deleting consensus metadata
I20260810 04:51:41.478907 32524 catalog_manager.cc:4841] TS c915a935bd0c45948879cad0e939b19f (127.15.239.194:36227): tablet cdb691d0971b40be98e709c21adad1da (table test-table [id=22e8f49421574635a26da2baedacbfff]) successfully deleted
I20260810 04:51:41.481355 830 tablet_replica.cc:330] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: stopping tablet replica
I20260810 04:51:41.481527 830 raft_consensus.cc:2229] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:51:41.481678 830 raft_consensus.cc:2258] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:51:41.483816 830 ts_tablet_manager.cc:1905] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:51:41.485445 830 ts_tablet_manager.cc:1918] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:51:41.485555 830 log.cc:1196] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/cdb691d0971b40be98e709c21adad1da
I20260810 04:51:41.485857 830 ts_tablet_manager.cc:1939] T cdb691d0971b40be98e709c21adad1da P 906ab4af92f049b4b23396fab260935a: Deleting consensus metadata
I20260810 04:51:41.486372 32521 catalog_manager.cc:4841] TS 906ab4af92f049b4b23396fab260935a (127.15.239.195:32801): tablet cdb691d0971b40be98e709c21adad1da (table test-table [id=22e8f49421574635a26da2baedacbfff]) successfully deleted
W20260810 04:51:41.489842 32520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:43847 (error 108)
I20260810 04:51:41.490123 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 387
I20260810 04:51:41.493404 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:51:41.493244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:43847 (local address 127.0.0.1:45104)
0810 04:51:41.493306 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 04:51:41.493364 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:43847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:51:41.493585 32520 catalog_manager.cc:4584] TS 9c4ffab14eb5476a95bac2c434190458 (127.15.239.193:43847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cdb691d0971b40be98e709c21adad1da: Network error: Client connection negotiation failed: client connection to 127.15.239.193:43847: connect: Connection refused (error 111)
I20260810 04:51:41.506910 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 588
I20260810 04:51:41.518901 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 32498
2026-08-10T04:51:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2369 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[837](info): set up 2 sockets
Aug 10 04:51:41 dist-test-slave-kvfs krb5kdc[837](info): commencing operation
krb5kdc: starting...
W20260810 04:51:42.838305 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:51:42 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:51:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:51:42Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/rangeradmin_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/rangeradmin_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/rangerlookup_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/rangerlookup_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
I20260810 04:51:43.052220 16319 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvaRG_7/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/postgres -l logfile start
2026-08-10 04:51:45.981 UTC [882] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 04:51:45.981 UTC [882] LOG: listening on IPv4 address "127.15.239.212", port 44773
2026-08-10 04:51:45.985 UTC [882] LOG: listening on Unix socket "/tmp/.s.PGSQL.44773"
2026-08-10 04:51:46.012 UTC [886] LOG: database system was shut down at 2026-08-10 04:51:44 UTC
2026-08-10 04:51:46.017 UTC [882] LOG: database system is ready to accept connections
I20260810 04:51:47.210772 16319 mini_postgres.cc:96] Postgres bound to 44773
2026-08-10 04:51:47.221 UTC [898] FATAL: database "slave" does not exist
127.15.239.212:44773 - accepting connections
I20260810 04:51:47.222872 16319 mini_ranger.cc:161] Starting Ranger...
I20260810 04:51:47.242404 16319 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 04:51:47.832523 16319 mini_ranger.cc:87] Created ranger Postgres database
I20260810 04:51:47.832644 16319 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-admin
2026-08-10 04:51:48,192 [I] DB FLAVOR :POSTGRES
2026-08-10 04:51:48,193 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:51:48,193 [I] Checking connection..
2026-08-10 04:51:48,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 04:51:48,500 [I] Checking connection passed.
2026-08-10 04:51:48,500 [I] --------- Verifying version history table ---------
2026-08-10 04:51:48,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:51:48,766 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:51:48,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:51:49,036 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:51:49,036 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 04:51:49,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 04:51:49.323 UTC [989] WARNING: there is no transaction in progress
2026-08-10 04:51:49,335 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 04:51:49,336 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:51:49,615 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 04:51:49,616 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:51:49,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 04:51:49,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 04:51:50,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-kvfs.c.gcp-upstream.internal','N') ;"
2026-08-10 04:51:50,476 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:51:50,769 [I] Table x_portal_user does not exist in database ranger
2026-08-10 04:51:50,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:51:51,061 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 04:51:51,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:51:51,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:51:51,644 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 04:51:51,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 04:51:52.783 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.802 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.822 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.841 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.860 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.883 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.950 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.958 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.975 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:52.987 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53.000 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53.017 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53.029 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53.037 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53.045 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53.052 UTC [1158] WARNING: there is no transaction in progress
2026-08-10 04:51:53,821 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 04:51:53,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 04:51:54,081 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 04:51:54,081 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:51:54,379 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 04:51:54,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:51:54,664 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 04:51:54,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:51:54,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:51:55,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-kvfs.c.gcp-upstream.internal';"
2026-08-10 04:51:55,568 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 04:51:55,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 04:51:55,853 [I] DB_PATCHES have already been applied
I20260810 04:51:55.861143 16319 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvaRG_7/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 04:51:55.861271 16319 mini_ranger.cc:193] Using host: 127.15.239.212
I20260810 04:51:55.867022 16319 mini_ranger.cc:227] Ranger admin URL: http://127.15.239.212:46045
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 4:51:56 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 04:51:57.313918 16319 mini_ranger.cc:160] Time spent starting Ranger: real 10.091s user 0.004s sys 0.012s
Aug 10, 2026 4:52:19 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 4:52:19 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 4:52:19 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 4:52:19 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 4:52:20 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 04:52:21.429247 16319 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/rangerkms_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/rangerkms_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.239.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.239.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 04:52:21 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337541, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 04:52:21.534730 16319 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 04:52:21.547403 16319 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 04:52:22.543911 16319 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 04:52:22.544060 16319 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms
I20260810 04:52:22.544081 16319 mini_ranger_kms.cc:227] Using postgres at 127.15.239.212:44773
2026-08-10 04:52:22,891 [I] DB FLAVOR :POSTGRES
2026-08-10 04:52:22,891 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:52:22,891 [I] Checking connection
2026-08-10 04:52:22,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 04:52:23,155 [I] connection success
2026-08-10 04:52:23,155 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 04:52:23,155 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 04:52:23,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 04:52:23,452 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 04:52:23,452 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:52:23,453 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 04:52:23,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:44773/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 04:52:23,770 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 04:52:24.333192 16319 mini_ranger_kms.cc:310] Created kms service
I20260810 04:52:24.542105 16319 mini_ranger_kms.cc:326] Created kudu user
I20260810 04:52:24.594609 16319 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 04:52:24 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337541, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:52:25.047838 16319 mini_ranger_kms.cc:384] Added ranger policy
I20260810 04:52:25.048000 16319 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 04:52:25.048050 16319 mini_ranger_kms.cc:240] Using host: 127.15.239.212
I20260810 04:52:25.054463 16319 mini_ranger_kms.cc:276] Ranger KMS PID: 1429
I20260810 04:52:25.054698 16319 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.239.212:55017
Aug 10, 2026 4:52:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:52:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:52:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 4:52:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 4:52:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 4:52:26 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 04:52:27 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786337547, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.239.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:52:28.044598 16319 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.510s user 0.003s sys 0.328s
I20260810 04:52:28.044749 16319 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 04:52:28.044865 16319 mini_ranger_kms.cc:401] 127.15.239.212:55017/kms/v1/keys
Aug 10 04:52:28 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337547, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.239.212@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
Aug 10 04:52:28 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337547, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.239.212@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
Aug 10 04:52:31 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:52:31.225449 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36751
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36751
--ranger_config_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:55017/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:52:31.326530 1513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:52:31.326798 1513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:52:31.326824 1513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:52:31.328121 1513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:52:31.328171 1513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:52:31.328186 1513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:52:31.328198 1513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:52:31.328210 1513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:52:31.330024 1513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.239.212:55017/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36751
--ranger_config_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:52:31.330329 1513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:52:31.330631 1513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:52:31.336848 1525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:31.336819 1519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:52:31.336861 1513 server_base.cc:1034] running on GCE node
W20260810 04:52:31.336825 1520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:52:31.337343 1513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:52:31.337728 1513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:52:31.338915 1513 hybrid_clock.cc:648] HybridClock initialized: now 1786337551338899 us; error 47 us; skew 500 ppm
Aug 10 04:52:31 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337551, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:52:31.345209 1513 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:52:31.345757 1513 webserver.cc:460] Webserver started at http://127.15.239.254:44711/ using document root <none> and password file <none>
I20260810 04:52:31.346048 1513 fs_manager.cc:359] Metadata directory not provided
I20260810 04:52:31.346114 1513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:52:31.346287 1513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:52:31 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337551, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:52:31.411016 1513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "4401630c506e4d99a393936f56f2d1e3"
format_stamp: "Formatted at 2026-08-10 04:52:31 on dist-test-slave-kvfs"
server_key: "3cf1b797fdc709b64c27cbd77f1dad70"
server_key_iv: "e1f74be923fc5d2ba8bc9d3e96fa31ba"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:31.411569 1513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "4401630c506e4d99a393936f56f2d1e3"
format_stamp: "Formatted at 2026-08-10 04:52:31 on dist-test-slave-kvfs"
server_key: "3cf1b797fdc709b64c27cbd77f1dad70"
server_key_iv: "e1f74be923fc5d2ba8bc9d3e96fa31ba"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:31.413408 1513 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260810 04:52:31.432204 1536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:31.432574 1513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:52:31.432732 1513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "4401630c506e4d99a393936f56f2d1e3"
format_stamp: "Formatted at 2026-08-10 04:52:31 on dist-test-slave-kvfs"
server_key: "3cf1b797fdc709b64c27cbd77f1dad70"
server_key_iv: "e1f74be923fc5d2ba8bc9d3e96fa31ba"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:31.432888 1513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:52:31.451534 1513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:52:31.453789 1513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:52:31.453977 1513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:52:31.459246 1513 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:36751
I20260810 04:52:31.459287 1620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:36751 every 8 connection(s)
I20260810 04:52:31.459772 1513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:52:31.460709 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:52:31.463577 1621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3: Bootstrap starting.
I20260810 04:52:31.464393 1621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3: Neither blocks nor log segments found. Creating new log.
I20260810 04:52:31.464862 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 1513
I20260810 04:52:31.464890 1621 log.cc:824] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:52:31.465020 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:52:31.465303 16319 external_mini_cluster.cc:1428] Setting key 16db9dbdd7ed239c660de1fd5537875a
I20260810 04:52:31.465982 1621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3: No bootstrap required, opened a new log
I20260810 04:52:31.468943 1621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4401630c506e4d99a393936f56f2d1e3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36751 } }
I20260810 04:52:31.469122 1621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:52:31.469151 1621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4401630c506e4d99a393936f56f2d1e3, State: Initialized, Role: FOLLOWER
I20260810 04:52:31.469399 1621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4401630c506e4d99a393936f56f2d1e3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36751 } }
I20260810 04:52:31.469520 1621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:52:31.469575 1621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:52:31.469659 1621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:52:31.470489 1621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4401630c506e4d99a393936f56f2d1e3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36751 } }
I20260810 04:52:31.470638 1621 leader_election.cc:302] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4401630c506e4d99a393936f56f2d1e3; no voters:
I20260810 04:52:31.470863 1621 leader_election.cc:288] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:52:31.470918 1627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:52:31.471101 1627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [term 1 LEADER]: Becoming Leader. State: Replica: 4401630c506e4d99a393936f56f2d1e3, State: Running, Role: LEADER
I20260810 04:52:31.471216 1621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:52:31.471246 1627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4401630c506e4d99a393936f56f2d1e3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36751 } }
I20260810 04:52:31.471783 1628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4401630c506e4d99a393936f56f2d1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4401630c506e4d99a393936f56f2d1e3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36751 } } }
I20260810 04:52:31.471871 1628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [sys.catalog]: This master's current role is: LEADER
I20260810 04:52:31.472188 1629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4401630c506e4d99a393936f56f2d1e3. Latest consensus state: current_term: 1 leader_uuid: "4401630c506e4d99a393936f56f2d1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4401630c506e4d99a393936f56f2d1e3" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36751 } } }
I20260810 04:52:31.472261 1629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3 [sys.catalog]: This master's current role is: LEADER
I20260810 04:52:31.472616 1635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:52:31.473249 1635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:52:31.473845 1621 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 10 04:52:31 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:52:31.478119 1635 catalog_manager.cc:1347] Generated new cluster ID: d29aafb8b479475bb6293bb0a4e94022
I20260810 04:52:31.478303 1635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:52:31.483724 1626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:31.466051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58488 (local address 127.15.239.254:36751)
0810 04:52:31.466288 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:31.466299 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:31.466333 (+ 34us) server_negotiation.cc:407] Connection header received
0810 04:52:31.468940 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:31.468968 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:31.469038 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:31.469244 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:52:31.470132 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:31.471524 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:31.472937 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:31.473596 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:31.473711 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:31.477553 (+ 3842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:52:31.477615 (+ 62us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:52:31.477615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:52:31.477742 (+ 127us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:52:31.480777 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:31.481277 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:31.481281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:31.481282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:31.481424 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:31.481675 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:31.481676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:31.481676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:31.482081 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:52:31.482313 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:31.482878 (+ 565us) server_negotiation.cc:299] Negotiation successful
0810 04:52:31.483076 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":129,"threads_started":1}
I20260810 04:52:31.516215 1635 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:52:31.517002 1635 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:52:31.520483 1635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3: Generated new TSK 0
I20260810 04:52:31.520714 1635 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:52:32.264245 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:55017/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36751
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:52:32.386490 1679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:52:32.386770 1679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:52:32.386812 1679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:52:32.388234 1679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:52:32.388298 1679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:52:32.388345 1679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:52:32.390458 1679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.239.212:55017/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:52:32.390751 1679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:52:32.391093 1679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:52:32.397473 1694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:32.397490 1688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:32.397766 1697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:52:32.397994 1679 server_base.cc:1034] running on GCE node
I20260810 04:52:32.398241 1679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:52:32.398531 1679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:52:32.399708 1679 hybrid_clock.cc:648] HybridClock initialized: now 1786337552399691 us; error 32 us; skew 500 ppm
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:52:32.403105 1679 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:52:32.403786 1679 webserver.cc:460] Webserver started at http://127.15.239.193:46581/ using document root <none> and password file <none>
I20260810 04:52:32.404142 1679 fs_manager.cc:359] Metadata directory not provided
I20260810 04:52:32.404220 1679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:52:32.404423 1679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:52:32.421473 1679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "87568ab290234b10983e29758b8ecec4"
format_stamp: "Formatted at 2026-08-10 04:52:32 on dist-test-slave-kvfs"
server_key: "8cff1b6e659a0275d956ede42787cdad"
server_key_iv: "3fedbc21ae554012c69ea19c6ed37fe3"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:32.422036 1679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "87568ab290234b10983e29758b8ecec4"
format_stamp: "Formatted at 2026-08-10 04:52:32 on dist-test-slave-kvfs"
server_key: "8cff1b6e659a0275d956ede42787cdad"
server_key_iv: "3fedbc21ae554012c69ea19c6ed37fe3"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:32.428643 1679 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.002s
I20260810 04:52:32.451637 1709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:32.452049 1679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260810 04:52:32.452230 1679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "87568ab290234b10983e29758b8ecec4"
format_stamp: "Formatted at 2026-08-10 04:52:32 on dist-test-slave-kvfs"
server_key: "8cff1b6e659a0275d956ede42787cdad"
server_key_iv: "3fedbc21ae554012c69ea19c6ed37fe3"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:32.452394 1679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:52:32.491667 1679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:52:32.494259 1679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:52:32.494477 1679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:52:32.494838 1679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:52:32.495313 1679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:52:32.495370 1679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:32.495450 1679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:52:32.495488 1679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:32.503832 1679 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:34897
I20260810 04:52:32.504539 1679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:52:32.507026 1879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:34897 every 8 connection(s)
I20260810 04:52:32.508512 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 1679
I20260810 04:52:32.508647 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:52:32.508901 16319 external_mini_cluster.cc:1428] Setting key a6d531444fb0285ff37cc7ce0dade787
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:52:32.519855 1882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:32.505907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:40523 (local address 127.15.239.254:36751)
0810 04:52:32.507340 (+ 1433us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:32.507344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:32.507677 (+ 333us) server_negotiation.cc:407] Connection header received
0810 04:52:32.508617 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:32.508619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:32.508640 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:32.508724 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:52:32.509686 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.510463 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.512122 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.512432 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.512520 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:32.515621 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:52:32.515623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:52:32.515623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:52:32.515633 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:52:32.517887 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:32.518485 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:32.518487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:32.518488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:32.518563 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:32.518900 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:32.518901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:32.518901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:32.519079 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:52:32.519132 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:32.519611 (+ 479us) server_negotiation.cc:299] Negotiation successful
0810 04:52:32.519714 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1376,"thread_start_us":114,"threads_started":1}
I20260810 04:52:32.521018 1883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:32.505897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36751 (local address 127.15.239.193:40523)
0810 04:52:32.507525 (+ 1628us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:32.507568 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:32.508397 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:32.508904 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:32.508910 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:32.509232 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:52:32.509573 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:32.509580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.510582 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.510584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:32.511990 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:32.511993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.512529 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.512530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:32.512706 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:32.513445 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:52:32.513459 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:52:32.515505 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:52:32.517994 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:52:32.518002 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:52:32.518005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:52:32.518384 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:52:32.518648 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:52:32.518648 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:52:32.518649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:52:32.518812 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:52:32.519186 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:52:32.519194 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:52:32.519428 (+ 234us) client_negotiation.cc:769] Sending connection context
0810 04:52:32.520500 (+ 1072us) client_negotiation.cc:240] Negotiation successful
0810 04:52:32.520711 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1558,"thread_start_us":113,"threads_started":1}
I20260810 04:52:32.521894 1880 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36751
I20260810 04:52:32.522076 1880 heartbeater.cc:464] Registering TS with master...
I20260810 04:52:32.522403 1880 heartbeater.cc:511] Master 127.15.239.254:36751 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
I20260810 04:52:32.523136 1566 ts_manager.cc:194] Registered new tserver with Master: 87568ab290234b10983e29758b8ecec4 (127.15.239.193:34897)
I20260810 04:52:32.523855 1566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:40523
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:52:32.553608 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:55017/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36751
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 04:52:32.668365 1888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:52:32.668835 1888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:52:32.668938 1888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:52:32.670827 1888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:52:32.670944 1888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:52:32.671046 1888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:52:32.673442 1888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.239.212:55017/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:52:32.673990 1888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:52:32.674362 1888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:52:32.681522 1899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:32.681742 1896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:32.681499 1902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:52:32.683037 1888 server_base.cc:1034] running on GCE node
I20260810 04:52:32.683306 1888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:52:32.683584 1888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:52:32.684748 1888 hybrid_clock.cc:648] HybridClock initialized: now 1786337552684719 us; error 45 us; skew 500 ppm
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:52:32.688908 1888 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:52:32.689657 1888 webserver.cc:460] Webserver started at http://127.15.239.194:41171/ using document root <none> and password file <none>
I20260810 04:52:32.690038 1888 fs_manager.cc:359] Metadata directory not provided
I20260810 04:52:32.690176 1888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:52:32.690419 1888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:52:32.708664 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "0ed3918660084afabec1c2fb91b69557"
format_stamp: "Formatted at 2026-08-10 04:52:32 on dist-test-slave-kvfs"
server_key: "3cc47159b50c9661e6192fa60f963dcd"
server_key_iv: "10711d8ef9f40d080dc693be4a9e2acb"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:32.709385 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "0ed3918660084afabec1c2fb91b69557"
format_stamp: "Formatted at 2026-08-10 04:52:32 on dist-test-slave-kvfs"
server_key: "3cc47159b50c9661e6192fa60f963dcd"
server_key_iv: "10711d8ef9f40d080dc693be4a9e2acb"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:32.712827 1888 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 04:52:32.744227 1912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:32.744746 1888 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.000s sys 0.001s
I20260810 04:52:32.744940 1888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "0ed3918660084afabec1c2fb91b69557"
format_stamp: "Formatted at 2026-08-10 04:52:32 on dist-test-slave-kvfs"
server_key: "3cc47159b50c9661e6192fa60f963dcd"
server_key_iv: "10711d8ef9f40d080dc693be4a9e2acb"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:32.745154 1888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:52:32.781217 1888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:52:32.784207 1888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:52:32.784718 1888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:52:32.785224 1888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:52:32.785778 1888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:52:32.785868 1888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:32.785940 1888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:52:32.785991 1888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:32.793874 1888 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:43191
I20260810 04:52:32.794593 1888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:52:32.795387 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 1888
I20260810 04:52:32.795516 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:52:32.795748 16319 external_mini_cluster.cc:1428] Setting key 16ee5b739f26bc4bcc33058c25bc17e7
I20260810 04:52:32.802179 2082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:43191 every 8 connection(s)
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
I20260810 04:52:32.817374 1882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:32.805001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:56411 (local address 127.15.239.254:36751)
0810 04:52:32.805079 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:32.805082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:32.805446 (+ 364us) server_negotiation.cc:407] Connection header received
0810 04:52:32.806147 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:32.806149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:32.806171 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:32.806217 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:52:32.806971 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.807672 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.809264 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.809605 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.809657 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:32.813007 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:52:32.813009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:52:32.813010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:52:32.813021 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:52:32.815004 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:32.815853 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:32.815855 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:32.815855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:32.815931 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:32.816323 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:32.816324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:32.816324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:32.816507 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:52:32.816583 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:32.817073 (+ 490us) server_negotiation.cc:299] Negotiation successful
0810 04:52:32.817219 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:52:32.817680 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:32.805005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36751 (local address 127.15.239.194:56411)
0810 04:52:32.805268 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:32.805322 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:32.806015 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:32.806327 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:32.806332 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:32.806594 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:52:32.806862 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:32.806867 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.807801 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.807802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:32.809144 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:32.809148 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:32.809775 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:32.809776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:32.809965 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:32.810744 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:52:32.810758 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:52:32.812868 (+ 2110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:52:32.815170 (+ 2302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:52:32.815181 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:52:32.815185 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:52:32.815754 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:52:32.816041 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:52:32.816042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:52:32.816043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:52:32.816225 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:52:32.816641 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:52:32.816649 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:52:32.816879 (+ 230us) client_negotiation.cc:769] Sending connection context
0810 04:52:32.817012 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 04:52:32.817371 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":161,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
I20260810 04:52:32.819096 2083 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36751
I20260810 04:52:32.819231 2083 heartbeater.cc:464] Registering TS with master...
I20260810 04:52:32.819520 2083 heartbeater.cc:511] Master 127.15.239.254:36751 requested a full tablet report, sending...
I20260810 04:52:32.820070 1566 ts_manager.cc:194] Registered new tserver with Master: 0ed3918660084afabec1c2fb91b69557 (127.15.239.194:43191)
I20260810 04:52:32.820660 1566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:56411
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:52:32.844067 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:55017/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36751
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:52:32.984845 2094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:52:32.985227 2094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:52:32.985270 2094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:52:32.987046 2094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:52:32.987112 2094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:52:32.987154 2094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:52:32.989583 2094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.239.212:55017/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:36751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:52:32.989974 2094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:52:32.990406 2094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:52:32.997696 2108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:32.997663 2101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:52:32.997696 2102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:52:32.998643 2094 server_base.cc:1034] running on GCE node
I20260810 04:52:32.998926 2094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:52:32.999235 2094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:52:33.000440 2094 hybrid_clock.cc:648] HybridClock initialized: now 1786337553000433 us; error 47 us; skew 500 ppm
Aug 10 04:52:32 dist-test-slave-kvfs krb5kdc[837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:52:33.004341 2094 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:52:33.005023 2094 webserver.cc:460] Webserver started at http://127.15.239.195:36397/ using document root <none> and password file <none>
I20260810 04:52:33.005321 2094 fs_manager.cc:359] Metadata directory not provided
I20260810 04:52:33.005503 2094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:52:33.005689 2094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:52:33 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:52:33.022940 2094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "c42736c28da743ae9ac42a2fabbaa996"
format_stamp: "Formatted at 2026-08-10 04:52:33 on dist-test-slave-kvfs"
server_key: "f9569de2fa6c324e9d2343533b8b7f61"
server_key_iv: "f46e579c27dbde3a44ed31125360856f"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:33.023782 2094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "c42736c28da743ae9ac42a2fabbaa996"
format_stamp: "Formatted at 2026-08-10 04:52:33 on dist-test-slave-kvfs"
server_key: "f9569de2fa6c324e9d2343533b8b7f61"
server_key_iv: "f46e579c27dbde3a44ed31125360856f"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:33.025969 2094 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 04:52:33.043128 2119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:33.043473 2094 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 04:52:33.043601 2094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "c42736c28da743ae9ac42a2fabbaa996"
format_stamp: "Formatted at 2026-08-10 04:52:33 on dist-test-slave-kvfs"
server_key: "f9569de2fa6c324e9d2343533b8b7f61"
server_key_iv: "f46e579c27dbde3a44ed31125360856f"
server_key_version: "kuduclusterkey@0"
I20260810 04:52:33.043736 2094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:52:33.103849 2094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:52:33.108207 2094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:52:33.108428 2094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:52:33.108788 2094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:52:33.109279 2094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:52:33.109331 2094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:33.109370 2094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:52:33.109397 2094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:52:33.121196 2094 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:44357
I20260810 04:52:33.121800 2094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:52:33.122495 2289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:44357 every 8 connection(s)
I20260810 04:52:33.128322 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 2094
I20260810 04:52:33.128453 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:52:33.128690 16319 external_mini_cluster.cc:1428] Setting key d37cb7c8d0461864b709697911a1554b
Aug 10 04:52:33 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:52:33.136132 1882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.122894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:34525 (local address 127.15.239.254:36751)
0810 04:52:33.122958 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.122961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.124386 (+ 1425us) server_negotiation.cc:407] Connection header received
0810 04:52:33.125177 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.125179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.125196 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.125289 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:52:33.126210 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.127081 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.128828 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.129136 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.129192 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.132258 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:52:33.132260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:52:33.132260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:52:33.132270 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:52:33.134126 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:33.134718 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:33.134720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:33.134720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:33.134805 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:33.135135 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:33.135136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:33.135137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:33.135310 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:52:33.135382 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.135834 (+ 452us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.135972 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:52:33.136864 2293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.122872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36751 (local address 127.15.239.195:34525)
0810 04:52:33.124182 (+ 1310us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.124244 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:33.125033 (+ 789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:33.125396 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:33.125402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:33.125725 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:52:33.126082 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.126088 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.127215 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.127217 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.128692 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.128696 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.129316 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.129317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.129478 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.130224 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:52:33.130236 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:52:33.132150 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:52:33.134230 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:52:33.134238 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:52:33.134241 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:52:33.134613 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:52:33.134881 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:52:33.134882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:52:33.134883 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:52:33.135046 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:52:33.135416 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:52:33.135424 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:52:33.135628 (+ 204us) client_negotiation.cc:769] Sending connection context
0810 04:52:33.136329 (+ 701us) client_negotiation.cc:240] Negotiation successful
0810 04:52:33.136549 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1251,"thread_start_us":96,"threads_started":1}
I20260810 04:52:33.137445 2291 heartbeater.cc:347] Connected to a master server at 127.15.239.254:36751
I20260810 04:52:33.137578 2291 heartbeater.cc:464] Registering TS with master...
I20260810 04:52:33.137856 2291 heartbeater.cc:511] Master 127.15.239.254:36751 requested a full tablet report, sending...
I20260810 04:52:33.138320 1566 ts_manager.cc:194] Registered new tserver with Master: c42736c28da743ae9ac42a2fabbaa996 (127.15.239.195:44357)
I20260810 04:52:33.138895 1566 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:34525
I20260810 04:52:33.140818 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:52:33.153892 1882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.144401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58498 (local address 127.15.239.254:36751)
0810 04:52:33.144461 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.144463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.144789 (+ 326us) server_negotiation.cc:407] Connection header received
0810 04:52:33.144951 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.144952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.144966 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.144997 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:52:33.145882 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.146681 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.148071 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.148390 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.148470 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.150395 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:52:33.150397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:52:33.150397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:52:33.150407 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:52:33.152444 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:33.152923 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:33.152925 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:33.152925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:33.152999 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:52:33.153229 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:52:33.153230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:52:33.153231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:52:33.153399 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:52:33.153517 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.153669 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.153760 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:52:33.156081 1566 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:52:33.158989 1566 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:52:33.171893 2311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.166385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34897 (local address 127.0.0.1:56674)
0810 04:52:33.167055 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.167063 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:33.167102 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:33.167514 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:33.167518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:33.167521 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:52:33.167614 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.167616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.169043 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.169044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.170380 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.170384 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.171548 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.171549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.171637 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.171662 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 04:52:33.171728 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:52:33.171789 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":98,"threads_started":1}
I20260810 04:52:33.172253 2315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.166665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56674 (local address 127.15.239.193:34897)
0810 04:52:33.167214 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.167221 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.167232 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:52:33.167276 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.167279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.167296 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.167378 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:52:33.167711 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.168942 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.170490 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.171352 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.171423 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.172089 (+ 666us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.172121 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.172175 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":56,"threads_started":1}
I20260810 04:52:33.173243 1778 tablet_service.cc:1467] Processing CreateTablet for tablet 764a5898cf50403f8f31858b44410dd6 (DEFAULT_TABLE table=test-table [id=bdcd510756ed4768a3af29bbdb753520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:52:33.173781 1778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 764a5898cf50403f8f31858b44410dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:52:33.177376 2309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.165459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44357 (local address 127.0.0.1:50858)
0810 04:52:33.165892 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.165954 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:33.170547 (+ 4593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:33.170971 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:33.170973 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:33.170976 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:52:33.171038 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.171039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.174244 (+ 3205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.174245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.176080 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.176083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.177113 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.177114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.177183 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.177188 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:52:33.177222 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 04:52:33.177269 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":120,"threads_started":1}
I20260810 04:52:33.178171 2316 tablet_bootstrap.cc:492] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: Bootstrap starting.
I20260810 04:52:33.178445 2310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.165606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50858 (local address 127.15.239.195:44357)
0810 04:52:33.170738 (+ 5132us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.170743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.170754 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:52:33.170817 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.170819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.170839 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.171119 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:52:33.171209 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.174125 (+ 2916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.176217 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.177019 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.177896 (+ 877us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.177975 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.178231 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.178348 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5073,"thread_start_us":120,"threads_started":1}
I20260810 04:52:33.179032 2316 tablet_bootstrap.cc:654] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: Neither blocks nor log segments found. Creating new log.
I20260810 04:52:33.179376 2316 log.cc:824] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:52:33.179940 2190 tablet_service.cc:1467] Processing CreateTablet for tablet 764a5898cf50403f8f31858b44410dd6 (DEFAULT_TABLE table=test-table [id=bdcd510756ed4768a3af29bbdb753520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:52:33.180356 2316 tablet_bootstrap.cc:492] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: No bootstrap required, opened a new log
I20260810 04:52:33.180401 2190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 764a5898cf50403f8f31858b44410dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:52:33.180423 2316 ts_tablet_manager.cc:1397] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:52:33.180693 2314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.165768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:43191 (local address 127.0.0.1:57478)
0810 04:52:33.166858 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.166868 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:33.166947 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:33.175379 (+ 8432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:33.175381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:33.175384 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:52:33.175439 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.175441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.178229 (+ 2788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.178230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.179339 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.179343 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.180446 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.180448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.180514 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.180519 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:52:33.180553 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 04:52:33.180604 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"thread_start_us":91,"threads_started":1}
I20260810 04:52:33.181090 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.166070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57478 (local address 127.15.239.194:43191)
0810 04:52:33.170036 (+ 3966us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.170042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.170055 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:52:33.170104 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.170106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.172616 (+ 2510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.175540 (+ 2924us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:52:33.175655 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.176980 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.179488 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.180331 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.180836 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.180917 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.180949 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.180994 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3905,"thread_start_us":127,"threads_started":1}
I20260810 04:52:33.183732 2316 raft_consensus.cc:348] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.184600 2316 raft_consensus.cc:374] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:52:33.184659 2316 raft_consensus.cc:729] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87568ab290234b10983e29758b8ecec4, State: Initialized, Role: FOLLOWER
I20260810 04:52:33.184828 2316 consensus_queue.cc:260] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.184974 1984 tablet_service.cc:1467] Processing CreateTablet for tablet 764a5898cf50403f8f31858b44410dd6 (DEFAULT_TABLE table=test-table [id=bdcd510756ed4768a3af29bbdb753520]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:52:33.185165 2316 ts_tablet_manager.cc:1428] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 04:52:33.185307 1880 heartbeater.cc:503] Master 127.15.239.254:36751 was elected leader, sending a full tablet report...
I20260810 04:52:33.185477 2318 tablet_bootstrap.cc:492] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Bootstrap starting.
I20260810 04:52:33.185497 1984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 764a5898cf50403f8f31858b44410dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:52:33.187044 2318 tablet_bootstrap.cc:654] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Neither blocks nor log segments found. Creating new log.
I20260810 04:52:33.187539 2318 log.cc:824] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Log is configured to *not* fsync() on all Append() calls
I20260810 04:52:33.188412 2318 tablet_bootstrap.cc:492] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: No bootstrap required, opened a new log
I20260810 04:52:33.188503 2318 ts_tablet_manager.cc:1397] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:52:33.190692 2318 raft_consensus.cc:348] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.190903 2318 raft_consensus.cc:374] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:52:33.190935 2318 raft_consensus.cc:729] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c42736c28da743ae9ac42a2fabbaa996, State: Initialized, Role: FOLLOWER
I20260810 04:52:33.191080 2318 consensus_queue.cc:260] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.191403 2318 ts_tablet_manager.cc:1428] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:52:33.192193 2291 heartbeater.cc:503] Master 127.15.239.254:36751 was elected leader, sending a full tablet report...
I20260810 04:52:33.192441 2324 tablet_bootstrap.cc:492] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Bootstrap starting.
I20260810 04:52:33.193836 2324 tablet_bootstrap.cc:654] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Neither blocks nor log segments found. Creating new log.
I20260810 04:52:33.194228 2324 log.cc:824] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Log is configured to *not* fsync() on all Append() calls
I20260810 04:52:33.195832 2324 tablet_bootstrap.cc:492] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: No bootstrap required, opened a new log
I20260810 04:52:33.195928 2324 ts_tablet_manager.cc:1397] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
Aug 10 04:52:33 dist-test-slave-kvfs krb5kdc[837](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337552, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:52:33.199383 2324 raft_consensus.cc:348] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.199648 2324 raft_consensus.cc:374] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:52:33.199710 2324 raft_consensus.cc:729] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed3918660084afabec1c2fb91b69557, State: Initialized, Role: FOLLOWER
I20260810 04:52:33.199894 2324 consensus_queue.cc:260] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.200348 2324 ts_tablet_manager.cc:1428] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260810 04:52:33.200418 2083 heartbeater.cc:503] Master 127.15.239.254:36751 was elected leader, sending a full tablet report...
W20260810 04:52:33.264169 1881 tablet.cc:2369] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:52:33.307606 2084 tablet.cc:2369] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:52:33.356633 2329 raft_consensus.cc:482] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:52:33.356853 2329 raft_consensus.cc:504] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.357426 2329 leader_election.cc:288] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87568ab290234b10983e29758b8ecec4 (127.15.239.193:34897), c42736c28da743ae9ac42a2fabbaa996 (127.15.239.195:44357)
I20260810 04:52:33.364296 2315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.358088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:53061 (local address 127.15.239.193:34897)
0810 04:52:33.358143 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.358146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.360239 (+ 2093us) server_negotiation.cc:407] Connection header received
0810 04:52:33.360416 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.360418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.360437 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.360500 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:52:33.360792 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.361557 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.363106 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.363820 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.363876 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.363889 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.364148 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.364200 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:52:33.364729 2331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.357872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34897 (local address 127.15.239.194:53061)
0810 04:52:33.360154 (+ 2282us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.360169 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:33.360287 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:33.360599 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:33.360601 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:33.360603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:52:33.360706 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.360708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.361669 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.361670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.362999 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.363002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.363953 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.363954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.364063 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.364068 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:52:33.364577 (+ 509us) client_negotiation.cc:240] Negotiation successful
0810 04:52:33.364638 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2258,"thread_start_us":81,"threads_started":1}
I20260810 04:52:33.365190 1808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "764a5898cf50403f8f31858b44410dd6" candidate_uuid: "0ed3918660084afabec1c2fb91b69557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87568ab290234b10983e29758b8ecec4" is_pre_election: true
I20260810 04:52:33.365415 1808 raft_consensus.cc:2454] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed3918660084afabec1c2fb91b69557 in term 0.
I20260810 04:52:33.365759 1917 leader_election.cc:302] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed3918660084afabec1c2fb91b69557, 87568ab290234b10983e29758b8ecec4; no voters:
I20260810 04:52:33.365924 2329 raft_consensus.cc:2781] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:52:33.365971 2329 raft_consensus.cc:482] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:52:33.365993 2329 raft_consensus.cc:3037] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:52:33.367136 2329 raft_consensus.cc:504] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.367297 2329 leader_election.cc:288] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [CANDIDATE]: Term 1 election: Requested vote from peers 87568ab290234b10983e29758b8ecec4 (127.15.239.193:34897), c42736c28da743ae9ac42a2fabbaa996 (127.15.239.195:44357)
I20260810 04:52:33.367604 1808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "764a5898cf50403f8f31858b44410dd6" candidate_uuid: "0ed3918660084afabec1c2fb91b69557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87568ab290234b10983e29758b8ecec4"
I20260810 04:52:33.367699 1808 raft_consensus.cc:3037] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:52:33.368841 1808 raft_consensus.cc:2454] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed3918660084afabec1c2fb91b69557 in term 1.
I20260810 04:52:33.369082 1917 leader_election.cc:302] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed3918660084afabec1c2fb91b69557, 87568ab290234b10983e29758b8ecec4; no voters:
I20260810 04:52:33.369402 2329 raft_consensus.cc:2781] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:52:33.369625 2329 raft_consensus.cc:686] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed3918660084afabec1c2fb91b69557, State: Running, Role: LEADER
I20260810 04:52:33.369746 2329 consensus_queue.cc:237] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } }
I20260810 04:52:33.370867 1566 catalog_manager.cc:5495] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed3918660084afabec1c2fb91b69557 (127.15.239.194). New cstate: current_term: 1 leader_uuid: "0ed3918660084afabec1c2fb91b69557" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed3918660084afabec1c2fb91b69557" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 43191 } health_report { overall_health: HEALTHY } } }
W20260810 04:52:33.372994 2292 tablet.cc:2369] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:52:33.377910 2310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.358414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:44349 (local address 127.15.239.195:44357)
0810 04:52:33.358484 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.358487 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.369182 (+ 10695us) server_negotiation.cc:407] Connection header received
0810 04:52:33.369243 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.369244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.369258 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.369305 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:52:33.369678 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.370512 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.376740 (+ 6228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.377407 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.377474 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.377487 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.377756 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.377811 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:52:33.378245 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.358292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44357 (local address 127.15.239.194:44349)
0810 04:52:33.369054 (+ 10762us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.369071 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:52:33.369167 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:52:33.369467 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:52:33.369469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:52:33.369472 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:52:33.369564 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.369567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.372067 (+ 2500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.372068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.376546 (+ 4478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:52:33.376555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.377570 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.377572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:52:33.377660 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.377666 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:52:33.378051 (+ 385us) client_negotiation.cc:240] Negotiation successful
0810 04:52:33.378121 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10738,"thread_start_us":90,"threads_started":1}
I20260810 04:52:33.378788 2194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "764a5898cf50403f8f31858b44410dd6" candidate_uuid: "0ed3918660084afabec1c2fb91b69557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c42736c28da743ae9ac42a2fabbaa996"
I20260810 04:52:33.378782 2202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "764a5898cf50403f8f31858b44410dd6" candidate_uuid: "0ed3918660084afabec1c2fb91b69557" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c42736c28da743ae9ac42a2fabbaa996" is_pre_election: true
I20260810 04:52:33.379050 2202 raft_consensus.cc:2454] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed3918660084afabec1c2fb91b69557 in term 0.
I20260810 04:52:33.411676 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.408166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57494 (local address 127.15.239.194:43191)
0810 04:52:33.408224 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 04:52:33.408226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:52:33.408233 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:52:33.408288 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:52:33.408289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:52:33.408317 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:52:33.408386 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:52:33.408589 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.409365 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.410479 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:52:33.410787 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:52:33.410844 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:52:33.411053 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:52:33.411221 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:52:33.411297 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:52:33.411530 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 04:52:33.411554 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 04:52:33.414243 2202 raft_consensus.cc:3037] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:52:33.414443 1808 raft_consensus.cc:1261] T 764a5898cf50403f8f31858b44410dd6 P 87568ab290234b10983e29758b8ecec4 [term 1 FOLLOWER]: Refusing update from remote peer 0ed3918660084afabec1c2fb91b69557: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:52:33.414953 2336 consensus_queue.cc:1035] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87568ab290234b10983e29758b8ecec4" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:52:33.415465 2202 raft_consensus.cc:1261] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 1 FOLLOWER]: Refusing update from remote peer 0ed3918660084afabec1c2fb91b69557: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:52:33.417865 2336 consensus_queue.cc:1035] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c42736c28da743ae9ac42a2fabbaa996" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:52:33.420307 2339 mvcc.cc:205] Tried to move back new op lower bound from 7316838618781208576 to 7316838618603118592. Current Snapshot: MvccSnapshot[applied={T|T < 7316838618781208576}]
I20260810 04:52:33.420434 2344 mvcc.cc:205] Tried to move back new op lower bound from 7316838618781208576 to 7316838618603118592. Current Snapshot: MvccSnapshot[applied={T|T < 7316838618781208576}]
I20260810 04:52:33.423144 2348 mvcc.cc:205] Tried to move back new op lower bound from 7316838618781208576 to 7316838618603118592. Current Snapshot: MvccSnapshot[applied={T|T < 7316838618781208576}]
I20260810 04:52:33.424504 1565 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:52:33.424645 1565 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:52:33.425590 1565 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4401630c506e4d99a393936f56f2d1e3: Sending DeleteTablet for 3 replicas of tablet 764a5898cf50403f8f31858b44410dd6
I20260810 04:52:33.426005 2190 tablet_service.cc:1514] Processing DeleteTablet for tablet 764a5898cf50403f8f31858b44410dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:52:33 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:50858
I20260810 04:52:33.426029 1984 tablet_service.cc:1514] Processing DeleteTablet for tablet 764a5898cf50403f8f31858b44410dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:52:33 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:57478
I20260810 04:52:33.426510 1778 tablet_service.cc:1514] Processing DeleteTablet for tablet 764a5898cf50403f8f31858b44410dd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:52:33 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:56674
I20260810 04:52:33.427203 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 1679
I20260810 04:52:33.444312 2355 tablet_replica.cc:330] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: stopping tablet replica
I20260810 04:52:33.444550 2355 raft_consensus.cc:2229] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:52:33.444772 2355 raft_consensus.cc:2258] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:52:33.445487 2355 ts_tablet_manager.cc:1905] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:52:33.448277 2355 ts_tablet_manager.cc:1918] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:52:33.448385 2355 log.cc:1196] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/764a5898cf50403f8f31858b44410dd6
I20260810 04:52:33.448724 2355 ts_tablet_manager.cc:1939] T 764a5898cf50403f8f31858b44410dd6 P 0ed3918660084afabec1c2fb91b69557: Deleting consensus metadata
I20260810 04:52:33.449327 2354 tablet_replica.cc:330] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: stopping tablet replica
I20260810 04:52:33.449440 1540 catalog_manager.cc:4841] TS 0ed3918660084afabec1c2fb91b69557 (127.15.239.194:43191): tablet 764a5898cf50403f8f31858b44410dd6 (table test-table [id=bdcd510756ed4768a3af29bbdb753520]) successfully deleted
I20260810 04:52:33.449512 2354 raft_consensus.cc:2229] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:52:33.449672 2354 raft_consensus.cc:2258] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 04:52:33.453276 1538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:34897 (error 108)
I20260810 04:52:33.454344 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 1888
I20260810 04:52:33.458788 2354 ts_tablet_manager.cc:1905] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:52:33.462291 2354 ts_tablet_manager.cc:1918] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:52:33.462394 2354 log.cc:1196] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/764a5898cf50403f8f31858b44410dd6
I20260810 04:52:33.462783 2354 ts_tablet_manager.cc:1939] T 764a5898cf50403f8f31858b44410dd6 P c42736c28da743ae9ac42a2fabbaa996: Deleting consensus metadata
I20260810 04:52:33.463436 1541 catalog_manager.cc:4841] TS c42736c28da743ae9ac42a2fabbaa996 (127.15.239.195:44357): tablet 764a5898cf50403f8f31858b44410dd6 (table test-table [id=bdcd510756ed4768a3af29bbdb753520]) successfully deleted
I20260810 04:52:33.470175 2314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:52:33.469980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34897 (local address 127.0.0.1:56686)
0810 04:52:33.470041 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:52:33.470108 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:34897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 04:52:33.470573 1538 catalog_manager.cc:4584] TS 87568ab290234b10983e29758b8ecec4 (127.15.239.193:34897): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 764a5898cf50403f8f31858b44410dd6: Network error: Client connection negotiation failed: client connection to 127.15.239.193:34897: connect: Connection refused (error 111)
I20260810 04:52:33.477262 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 2094
I20260810 04:52:33.494179 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 1513
I20260810 04:52:33.516981 16319 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 04:52:33.863777 16319 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 04:52:33.863919 16319 mini_ranger.cc:66] Stopping Ranger...
I20260810 04:52:34.219640 16319 mini_ranger.cc:68] Stopped Ranger
2026-08-10 04:52:34.219 UTC [882] LOG: received smart shutdown request
2026-08-10 04:52:34.224 UTC [882] LOG: background worker "logical replication launcher" (PID 895) exited with exit code 1
2026-08-10 04:52:34.225 UTC [889] LOG: shutting down
2026-08-10 04:52:34.408 UTC [882] LOG: database system is shut down
2026-08-10T04:52:34Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53000 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:52:34 dist-test-slave-kvfs krb5kdc[2372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:52:34 dist-test-slave-kvfs krb5kdc[2372](info): set up 2 sockets
Aug 10 04:52:34 dist-test-slave-kvfs krb5kdc[2372](info): commencing operation
krb5kdc: starting...
W20260810 04:52:35.842653 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:52:35 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:52:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:52:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/rangeradmin_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/rangeradmin_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/rangerlookup_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/rangerlookup_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
I20260810 04:52:36.067478 16319 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvaRG_7/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/postgres -l logfile start
2026-08-10 04:52:38.973 UTC [2415] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 04:52:38.973 UTC [2415] LOG: listening on IPv4 address "127.15.239.212", port 37767
2026-08-10 04:52:38.977 UTC [2415] LOG: listening on Unix socket "/tmp/.s.PGSQL.37767"
2026-08-10 04:52:39.003 UTC [2418] LOG: database system was shut down at 2026-08-10 04:52:37 UTC
2026-08-10 04:52:39.008 UTC [2415] LOG: database system is ready to accept connections
I20260810 04:52:40.201696 16319 mini_postgres.cc:96] Postgres bound to 37767
2026-08-10 04:52:40.211 UTC [2433] FATAL: database "slave" does not exist
127.15.239.212:37767 - accepting connections
I20260810 04:52:40.211946 16319 mini_ranger.cc:161] Starting Ranger...
I20260810 04:52:40.230831 16319 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 04:52:40.786754 16319 mini_ranger.cc:87] Created ranger Postgres database
I20260810 04:52:40.786882 16319 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-admin
2026-08-10 04:52:41,097 [I] DB FLAVOR :POSTGRES
2026-08-10 04:52:41,098 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:52:41,098 [I] Checking connection..
2026-08-10 04:52:41,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 04:52:41,390 [I] Checking connection passed.
2026-08-10 04:52:41,391 [I] --------- Verifying version history table ---------
2026-08-10 04:52:41,391 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:52:41,692 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:52:41,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:52:41,962 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 04:52:41,963 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 04:52:41,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 04:52:42.229 UTC [2531] WARNING: there is no transaction in progress
2026-08-10 04:52:42,237 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 04:52:42,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 04:52:42,527 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 04:52:42,527 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:52:42,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 04:52:42,805 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 04:52:43,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-kvfs.c.gcp-upstream.internal','N') ;"
2026-08-10 04:52:43,338 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:52:43,630 [I] Table x_portal_user does not exist in database ranger
2026-08-10 04:52:43,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:52:43,939 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 04:52:43,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:52:44,216 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:52:44,479 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 04:52:44,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 04:52:45.538 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.558 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.576 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.593 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.611 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.632 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.702 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.709 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.725 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.736 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.748 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.764 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.776 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.783 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.791 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:45.799 UTC [2694] WARNING: there is no transaction in progress
2026-08-10 04:52:46,546 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 04:52:46,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 04:52:46,796 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 04:52:46,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 04:52:47,105 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 04:52:47,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 04:52:47,397 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 04:52:47,397 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 04:52:47,657 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 04:52:47,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-kvfs.c.gcp-upstream.internal';"
2026-08-10 04:52:48,222 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 04:52:48,223 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 04:52:48,520 [I] DB_PATCHES have already been applied
I20260810 04:52:48.527400 16319 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvaRG_7/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 04:52:48.527530 16319 mini_ranger.cc:193] Using host: 127.15.239.212
I20260810 04:52:48.532930 16319 mini_ranger.cc:227] Ranger admin URL: http://127.15.239.212:60685
Aug 10, 2026 4:52:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:52:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:52:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 4:52:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 4:52:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 4:52:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 4:52:49 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 04:52:49.980451 16319 mini_ranger.cc:160] Time spent starting Ranger: real 9.769s user 0.000s sys 0.014s
Aug 10, 2026 4:53:11 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 4:53:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 10, 2026 4:53:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 4:53:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 4:53:12 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 04:53:13.459753 16319 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.239.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.239.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/rangerkms_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.239.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/rangerkms_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.239.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.239.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.239.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/HTTP_127.15.239.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 04:53:13 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337593, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 04:53:13.587189 16319 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 04:53:13.600497 16319 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 04:53:14.613708 16319 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 04:53:14.614008 16319 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms
I20260810 04:53:14.614063 16319 mini_ranger_kms.cc:227] Using postgres at 127.15.239.212:37767
2026-08-10 04:53:14,839 [I] DB FLAVOR :POSTGRES
2026-08-10 04:53:14,840 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 04:53:14,840 [I] Checking connection
2026-08-10 04:53:14,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 04:53:15,139 [I] connection success
2026-08-10 04:53:15,139 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 04:53:15,139 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 04:53:15,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 04:53:15,441 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 04:53:15,442 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 04:53:15,442 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 04:53:15,442 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.239.212:37767/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 04:53:15,753 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 04:53:16.314284 16319 mini_ranger_kms.cc:310] Created kms service
I20260810 04:53:16.549808 16319 mini_ranger_kms.cc:326] Created kudu user
I20260810 04:53:16.600595 16319 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 04:53:16 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337593, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:17.054196 16319 mini_ranger_kms.cc:384] Added ranger policy
I20260810 04:53:17.054495 16319 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvaRG_7/build/release/bin/postgresql.jar:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvaRG_7/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 04:53:17.054522 16319 mini_ranger_kms.cc:240] Using host: 127.15.239.212
I20260810 04:53:17.061060 16319 mini_ranger_kms.cc:276] Ranger KMS PID: 2960
I20260810 04:53:17.061172 16319 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.239.212:46663
Aug 10, 2026 4:53:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 4:53:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 4:53:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 4:53:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 4:53:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 4:53:18 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 04:53:19 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786337599, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.239.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:19.965291 16319 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.378s user 0.000s sys 0.208s
I20260810 04:53:19.965431 16319 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 04:53:19.965487 16319 mini_ranger_kms.cc:401] 127.15.239.212:46663/kms/v1/keys
Aug 10 04:53:20 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337599, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.239.212@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
Aug 10 04:53:20 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337599, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.239.212@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
Aug 10 04:53:23 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:53:23.432250 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:32927
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:32927
--ranger_config_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:23.533077 3032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:23.533351 3032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:23.533376 3032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:23.534590 3032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:23.534632 3032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:23.534647 3032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:23.534660 3032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:23.534672 3032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:23.536417 3032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.239.212:46663/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:32927
--ranger_config_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:23.536667 3032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:23.536890 3032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:53:23.543224 3032 server_base.cc:1034] running on GCE node
W20260810 04:53:23.543247 3043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:23.543296 3041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:23.543501 3045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:23.543833 3032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:23.544282 3032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:23.545502 3032 hybrid_clock.cc:648] HybridClock initialized: now 1786337603545492 us; error 41 us; skew 500 ppm
Aug 10 04:53:23 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337603, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:23.553867 3032 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:23.554493 3032 webserver.cc:460] Webserver started at http://127.15.239.254:43695/ using document root <none> and password file <none>
I20260810 04:53:23.554800 3032 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:23.554865 3032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:23.555056 3032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:53:23 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337603, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:23.622380 3032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "4d38acd0586945348f6ae1ab7bcffa55"
format_stamp: "Formatted at 2026-08-10 04:53:23 on dist-test-slave-kvfs"
server_key: "ec70f35f2653265a2406cae278e544d4"
server_key_iv: "69264ae6bb9c961930a7c6a3a6be083e"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:23.622969 3032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "4d38acd0586945348f6ae1ab7bcffa55"
format_stamp: "Formatted at 2026-08-10 04:53:23 on dist-test-slave-kvfs"
server_key: "ec70f35f2653265a2406cae278e544d4"
server_key_iv: "69264ae6bb9c961930a7c6a3a6be083e"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:23.625353 3032 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260810 04:53:23.645993 3057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:23.646250 3032 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:23.646384 3032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "4d38acd0586945348f6ae1ab7bcffa55"
format_stamp: "Formatted at 2026-08-10 04:53:23 on dist-test-slave-kvfs"
server_key: "ec70f35f2653265a2406cae278e544d4"
server_key_iv: "69264ae6bb9c961930a7c6a3a6be083e"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:23.646518 3032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:23.664275 3032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:23.666934 3032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:23.667119 3032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:23.673322 3032 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:32927
I20260810 04:53:23.673413 3134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:32927 every 8 connection(s)
I20260810 04:53:23.673873 3032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:23.674798 3137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:23.677919 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Bootstrap starting.
I20260810 04:53:23.678680 3137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:23.679034 3137 log.cc:824] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:23.680123 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: No bootstrap required, opened a new log
I20260810 04:53:23.682019 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 3032
I20260810 04:53:23.682150 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:53:23.682369 16319 external_mini_cluster.cc:1428] Setting key c65ad9750c790c700e2ce0c852cf6efe
I20260810 04:53:23.682718 3137 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:23.683000 3137 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:23.683075 3137 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d38acd0586945348f6ae1ab7bcffa55, State: Initialized, Role: FOLLOWER
I20260810 04:53:23.683274 3137 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:23.683477 3137 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:23.683542 3137 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:23.683629 3137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:23.684706 3137 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:23.684885 3137 leader_election.cc:302] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d38acd0586945348f6ae1ab7bcffa55; no voters:
I20260810 04:53:23.685132 3137 leader_election.cc:288] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:53:23.685163 3145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:23.685400 3145 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 LEADER]: Becoming Leader. State: Replica: 4d38acd0586945348f6ae1ab7bcffa55, State: Running, Role: LEADER
I20260810 04:53:23.685552 3145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:23.685588 3137 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:23.686004 3145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d38acd0586945348f6ae1ab7bcffa55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } } }
I20260810 04:53:23.686174 3145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:23.686393 3145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d38acd0586945348f6ae1ab7bcffa55. Latest consensus state: current_term: 1 leader_uuid: "4d38acd0586945348f6ae1ab7bcffa55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } } }
I20260810 04:53:23.686636 3145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:23.686817 3153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:23.687557 3153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:23.687903 3137 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 10 04:53:23 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:23.699724 3144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:23.683083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41876 (local address 127.15.239.254:32927)
0810 04:53:23.683340 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:23.683352 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:23.683450 (+ 98us) server_negotiation.cc:407] Connection header received
0810 04:53:23.683616 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:23.683626 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:23.683698 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:23.683874 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:23.684833 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:23.686459 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:23.687646 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:23.688322 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:23.691272 (+ 2950us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:23.692438 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:23.692451 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:23.692452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:23.692473 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:23.696297 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:23.696871 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:23.696875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:23.696875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:23.697515 (+ 640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:23.697789 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:23.697790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:23.697790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:23.698265 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:23.698974 (+ 709us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:23.699065 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 04:53:23.699347 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":112,"threads_started":1}
I20260810 04:53:23.704126 3174 mvcc.cc:205] Tried to move back new op lower bound from 7316838824731930624 to 7316838824696627200. Current Snapshot: MvccSnapshot[applied={T|T < 7316838824731930624}]
I20260810 04:53:23.705082 3153 catalog_manager.cc:1347] Generated new cluster ID: 9b65642f8e29450aaef5a4410c30625c
I20260810 04:53:23.705152 3153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:53:23.731572 3153 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:53:23.732718 3153 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:23.740056 3153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Generated new TSK 0
I20260810 04:53:23.740491 3153 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:53:24.584548 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:32927
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:24.713569 3200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:24.713827 3200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:24.713856 3200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:24.715119 3200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:24.715167 3200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:24.715195 3200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:53:24.716907 3200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.239.212:46663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:24.717201 3200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:24.717525 3200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:24.723539 3213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:24.723536 3208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:24.723944 3200 server_base.cc:1034] running on GCE node
W20260810 04:53:24.723569 3209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:24.724315 3200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:24.724694 3200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:24.725929 3200 hybrid_clock.cc:648] HybridClock initialized: now 1786337604725909 us; error 47 us; skew 500 ppm
Aug 10 04:53:24 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337604, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:24.729300 3200 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:53:24.729828 3200 webserver.cc:460] Webserver started at http://127.15.239.193:42339/ using document root <none> and password file <none>
I20260810 04:53:24.730150 3200 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:24.730228 3200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:24.730409 3200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:53:24 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337604, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:24.748764 3200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "dda785eda31447698c5112c8448334bf"
format_stamp: "Formatted at 2026-08-10 04:53:24 on dist-test-slave-kvfs"
server_key: "7818aa8e2b215343dc49d766042f8468"
server_key_iv: "a60c358edd43dc7a4954335c9855f64f"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:24.749341 3200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "dda785eda31447698c5112c8448334bf"
format_stamp: "Formatted at 2026-08-10 04:53:24 on dist-test-slave-kvfs"
server_key: "7818aa8e2b215343dc49d766042f8468"
server_key_iv: "a60c358edd43dc7a4954335c9855f64f"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:24.751432 3200 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:53:24.771529 3224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:24.771760 3200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:53:24.771895 3200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "dda785eda31447698c5112c8448334bf"
format_stamp: "Formatted at 2026-08-10 04:53:24 on dist-test-slave-kvfs"
server_key: "7818aa8e2b215343dc49d766042f8468"
server_key_iv: "a60c358edd43dc7a4954335c9855f64f"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:24.772069 3200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:24.790390 3200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:24.793058 3200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:24.793268 3200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:24.793591 3200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:24.794073 3200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:24.794132 3200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:24.794206 3200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:24.794242 3200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:24.802973 3200 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:37247
I20260810 04:53:24.803172 3387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:37247 every 8 connection(s)
I20260810 04:53:24.803665 3200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:53:24.810403 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 3200
I20260810 04:53:24.810525 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:53:24.810772 16319 external_mini_cluster.cc:1428] Setting key 523280a4010b7969f663fd4c2e05ae42
Aug 10 04:53:24 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337604, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:24.817364 3396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:24.804643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:32927 (local address 127.15.239.193:40503)
0810 04:53:24.804909 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:24.804981 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:24.805828 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:24.806235 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:24.806242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:24.806561 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:24.806929 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:24.806937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:24.808138 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:24.808140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:24.809596 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:24.809599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:24.810276 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:24.810277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:24.810449 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:24.811207 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:24.811227 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:24.813191 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:24.815432 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:24.815441 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:24.815445 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:24.815780 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:24.816060 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:24.816061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:24.816062 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:24.816217 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:24.816547 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:24.816554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:24.816752 (+ 198us) client_negotiation.cc:769] Sending connection context
0810 04:53:24.816871 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 04:53:24.817071 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":140,"threads_started":1}
I20260810 04:53:24.818048 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:24.804762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:40503 (local address 127.15.239.254:32927)
0810 04:53:24.804903 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:24.804907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:24.805083 (+ 176us) server_negotiation.cc:407] Connection header received
0810 04:53:24.805993 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:24.805994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:24.806014 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:24.806114 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:24.807071 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:24.807980 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:24.809710 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:24.810067 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:24.810149 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:24.813310 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:24.813312 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:24.813312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:24.813321 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:24.815333 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:24.815870 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:24.815871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:24.815871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:24.815941 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:24.816293 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:24.816294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:24.816295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:24.816456 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:24.816520 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:24.817809 (+ 1289us) server_negotiation.cc:299] Negotiation successful
0810 04:53:24.817908 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260810 04:53:24.818909 3390 heartbeater.cc:347] Connected to a master server at 127.15.239.254:32927
I20260810 04:53:24.819041 3390 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:24.819278 3390 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:24.820047 3078 ts_manager.cc:194] Registered new tserver with Master: dda785eda31447698c5112c8448334bf (127.15.239.193:37247)
I20260810 04:53:24.821070 3078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:40503
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:53:24.851804 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:32927
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:53:24 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786337604, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 04:53:24.996287 3403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:24.996814 3403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:24.996932 3403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:24.999074 3403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:24.999217 3403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:24.999310 3403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:53:25.002074 3403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.239.212:46663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:25.002430 3403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:25.002869 3403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:25.010520 3411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.010754 3410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.010536 3413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:25.011488 3403 server_base.cc:1034] running on GCE node
I20260810 04:53:25.011857 3403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:25.012251 3403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:25.013437 3403 hybrid_clock.cc:648] HybridClock initialized: now 1786337605013408 us; error 45 us; skew 500 ppm
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:25.017295 3403 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:53:25.017962 3403 webserver.cc:460] Webserver started at http://127.15.239.194:42655/ using document root <none> and password file <none>
I20260810 04:53:25.018328 3403 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:25.018409 3403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:25.018572 3403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:25.037253 3403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "5384ee59a771479e91a0548195c31839"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "716c436b14b8f2cc2fbb12bd02d9846d"
server_key_iv: "0b96fce30d63371aa9dea4a627ed42ff"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.037869 3403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "5384ee59a771479e91a0548195c31839"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "716c436b14b8f2cc2fbb12bd02d9846d"
server_key_iv: "0b96fce30d63371aa9dea4a627ed42ff"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.041626 3403 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 04:53:25.064608 3426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.064909 3403 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.000s
I20260810 04:53:25.065052 3403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "5384ee59a771479e91a0548195c31839"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "716c436b14b8f2cc2fbb12bd02d9846d"
server_key_iv: "0b96fce30d63371aa9dea4a627ed42ff"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.065212 3403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:25.105394 3403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:25.108575 3403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:25.108843 3403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:25.109238 3403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:25.109750 3403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:25.109845 3403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.109925 3403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:25.109985 3403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.118985 3403 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:33697
I20260810 04:53:25.119412 3593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:33697 every 8 connection(s)
I20260810 04:53:25.119704 3403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:53:25.123350 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 3403
I20260810 04:53:25.123492 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:53:25.123728 16319 external_mini_cluster.cc:1428] Setting key 5b4669413e92d8e60591389728f3ae47
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:25.156263 3597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:25.121169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:32927 (local address 127.15.239.194:55427)
0810 04:53:25.122494 (+ 1325us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:25.122555 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:25.123497 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:25.123984 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:25.123990 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:25.124333 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:25.124681 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:25.124689 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.136313 (+ 11624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.136315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:25.141800 (+ 5485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:25.141811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.147637 (+ 5826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.147638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:25.147876 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:25.148818 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:25.148833 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:25.151491 (+ 2658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:25.153925 (+ 2434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:25.153935 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:25.153940 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:25.154342 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:25.154614 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:25.154615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:25.154615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:25.154780 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:25.155191 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:25.155199 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:25.155448 (+ 249us) client_negotiation.cc:769] Sending connection context
0810 04:53:25.155581 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 04:53:25.155818 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1264,"thread_start_us":119,"threads_started":1}
I20260810 04:53:25.157048 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:25.121599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:55427 (local address 127.15.239.254:32927)
0810 04:53:25.121687 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:25.121690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:25.122685 (+ 995us) server_negotiation.cc:407] Connection header received
0810 04:53:25.123657 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:25.123659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:25.123681 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:25.123718 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:25.124799 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.125566 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.146274 (+ 20708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.146729 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.146796 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:25.151623 (+ 4827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:25.151626 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:25.151626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:25.151637 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:25.153758 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:25.154458 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:25.154459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:25.154460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:25.154533 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:25.154860 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:25.154861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:25.154862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:25.155063 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:25.155131 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:25.156777 (+ 1646us) server_negotiation.cc:299] Negotiation successful
0810 04:53:25.156902 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:53:25.158619 3594 heartbeater.cc:347] Connected to a master server at 127.15.239.254:32927
I20260810 04:53:25.158751 3594 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:25.159039 3594 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:25.159547 3078 ts_manager.cc:194] Registered new tserver with Master: 5384ee59a771479e91a0548195c31839 (127.15.239.194:33697)
I20260810 04:53:25.160143 3078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:55427
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:53:25.185793 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:32927
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:25.327716 3601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:25.328244 3601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:25.328387 3601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:25.330542 3601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:25.330694 3601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:25.330796 3601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:53:25.333484 3601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.239.212:46663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:25.334126 3601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:25.334582 3601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:25.341527 3613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.341570 3609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.341593 3610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:25.341922 3601 server_base.cc:1034] running on GCE node
I20260810 04:53:25.342154 3601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:25.342432 3601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:25.343622 3601 hybrid_clock.cc:648] HybridClock initialized: now 1786337605343599 us; error 45 us; skew 500 ppm
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:25.346866 3601 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:53:25.347617 3601 webserver.cc:460] Webserver started at http://127.15.239.195:44115/ using document root <none> and password file <none>
I20260810 04:53:25.348006 3601 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:25.348146 3601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:25.348326 3601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:25.369308 3601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "3c42e05f2f704ceea5baec34f724c445"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "6b53c22d31abaa0f7083583b30a4cdfe"
server_key_iv: "55805df8ddd3f54fec3521dfb737247a"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.372306 3601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "3c42e05f2f704ceea5baec34f724c445"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "6b53c22d31abaa0f7083583b30a4cdfe"
server_key_iv: "55805df8ddd3f54fec3521dfb737247a"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.374853 3601 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 04:53:25.402091 3620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.402462 3601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 04:53:25.402601 3601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "3c42e05f2f704ceea5baec34f724c445"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "6b53c22d31abaa0f7083583b30a4cdfe"
server_key_iv: "55805df8ddd3f54fec3521dfb737247a"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.402751 3601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:25.432791 3601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:25.443859 3601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:25.444103 3601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:25.444391 3601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:25.444948 3601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:25.445006 3601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.445043 3601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:25.445098 3601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.453085 3601 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:39329
I20260810 04:53:25.453785 3601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:53:25.456068 3795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:39329 every 8 connection(s)
I20260810 04:53:25.461727 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 3601
I20260810 04:53:25.461865 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:53:25.462113 16319 external_mini_cluster.cc:1428] Setting key 4179e8071b8180255aa972111a8ee7d4
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:25.468370 3400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:25.454947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:56903 (local address 127.15.239.254:32927)
0810 04:53:25.455012 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:25.455015 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:25.455791 (+ 776us) server_negotiation.cc:407] Connection header received
0810 04:53:25.456694 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:25.456696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:25.456713 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:25.456749 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:25.457770 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.458630 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.460284 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.460609 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.460661 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:25.464743 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:25.464745 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:25.464745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:25.464755 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:25.466528 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:25.467079 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:25.467081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:25.467081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:25.467156 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:25.467483 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:25.467484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:25.467485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:25.467652 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:25.467721 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:25.468149 (+ 428us) server_negotiation.cc:299] Negotiation successful
0810 04:53:25.468248 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:53:25.468577 3801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:25.454955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:32927 (local address 127.15.239.195:56903)
0810 04:53:25.455618 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:25.455674 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:25.456542 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:25.456987 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:25.456992 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:25.457297 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:25.457649 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:25.457655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.458758 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.458760 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:25.460177 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:25.460180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:25.460794 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:25.460795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:25.460951 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:25.462710 (+ 1759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:25.462723 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:25.464631 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:25.466626 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:25.466636 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:25.466639 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:25.466982 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:25.467232 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:25.467233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:25.467233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:25.467404 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:25.467733 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:25.467740 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:25.467937 (+ 197us) client_negotiation.cc:769] Sending connection context
0810 04:53:25.468092 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 04:53:25.468286 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":567,"threads_started":1}
I20260810 04:53:25.469251 3798 heartbeater.cc:347] Connected to a master server at 127.15.239.254:32927
I20260810 04:53:25.469388 3798 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:25.469624 3798 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:25.470062 3078 ts_manager.cc:194] Registered new tserver with Master: 3c42e05f2f704ceea5baec34f724c445 (127.15.239.195:39329)
I20260810 04:53:25.470603 3078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:56903
I20260810 04:53:25.473968 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:53:25.474825 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 3200
I20260810 04:53:25.517096 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 3403
I20260810 04:53:25.559867 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 3601
I20260810 04:53:25.577584 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 3032
I20260810 04:53:25.592976 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:32927
--webserver_interface=127.15.239.254
--webserver_port=43695
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:32927
--ranger_config_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:25.688805 3802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:25.689069 3802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:25.689095 3802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:25.690331 3802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:25.690382 3802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:25.690397 3802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:25.690410 3802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:25.690469 3802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:25.692212 3802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:32927
--ranger_config_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=43695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:25.692500 3802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:25.692759 3802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:25.698625 3816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.698693 3812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.698634 3811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:25.698869 3802 server_base.cc:1034] running on GCE node
I20260810 04:53:25.699285 3802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:25.699646 3802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:25.700793 3802 hybrid_clock.cc:648] HybridClock initialized: now 1786337605700774 us; error 42 us; skew 500 ppm
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:25.703629 3802 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:25.704276 3802 webserver.cc:460] Webserver started at http://127.15.239.254:43695/ using document root <none> and password file <none>
I20260810 04:53:25.704536 3802 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:25.704622 3802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:25.749677 3802 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:25.750680 3834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.750932 3802 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:25.751091 3802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "4d38acd0586945348f6ae1ab7bcffa55"
format_stamp: "Formatted at 2026-08-10 04:53:23 on dist-test-slave-kvfs"
server_key: "ec70f35f2653265a2406cae278e544d4"
server_key_iv: "69264ae6bb9c961930a7c6a3a6be083e"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.751601 3802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:25.763383 3802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:25.765846 3802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:25.766038 3802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:25.771136 3802 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:32927
I20260810 04:53:25.771239 3909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:32927 every 8 connection(s)
I20260810 04:53:25.771672 3802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:25.773305 3910 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:53:25.774132 3910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Bootstrap starting.
I20260810 04:53:25.780929 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 3802
I20260810 04:53:25.781412 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:37247
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:32927
--webserver_port=42339
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:53:25.785369 3910 log.cc:824] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:25.787758 3910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:53:25.788164 3910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Bootstrap complete.
I20260810 04:53:25.791895 3910 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:25.792341 3910 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d38acd0586945348f6ae1ab7bcffa55, State: Initialized, Role: FOLLOWER
I20260810 04:53:25.792658 3910 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:25.792786 3910 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:25.792877 3910 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:25.792968 3910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:53:25.794708 3910 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:25.794823 3910 leader_election.cc:302] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d38acd0586945348f6ae1ab7bcffa55; no voters:
I20260810 04:53:25.795082 3910 leader_election.cc:288] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:53:25.795183 3914 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:53:25.795449 3914 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [term 2 LEADER]: Becoming Leader. State: Replica: 4d38acd0586945348f6ae1ab7bcffa55, State: Running, Role: LEADER
I20260810 04:53:25.795449 3910 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:25.795696 3914 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } }
I20260810 04:53:25.797449 3910 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 04:53:25.800510 3919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d38acd0586945348f6ae1ab7bcffa55. Latest consensus state: current_term: 2 leader_uuid: "4d38acd0586945348f6ae1ab7bcffa55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } } }
I20260810 04:53:25.800526 3915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4d38acd0586945348f6ae1ab7bcffa55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d38acd0586945348f6ae1ab7bcffa55" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 32927 } } }
I20260810 04:53:25.800935 3919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:25.800938 3915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:25.801504 3943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:25.802575 3943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:25.802846 3943 catalog_manager.cc:1259] Loaded cluster ID: 9b65642f8e29450aaef5a4410c30625c
I20260810 04:53:25.802906 3943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:53:25.804630 3943 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:25.804893 3943 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Loaded TSK: 0
I20260810 04:53:25.805256 3943 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:53:25.919294 3912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:25.919670 3912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:25.919723 3912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:25.921851 3912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:25.921938 3912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:25.921991 3912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:53:25.924750 3912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:37247
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=42339
--tserver_master_addrs=127.15.239.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:25.925138 3912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:25.925531 3912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:25.933758 3965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:25.933879 3912 server_base.cc:1034] running on GCE node
W20260810 04:53:25.933967 3963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:25.933758 3968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:25.934367 3912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:25.934774 3912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:25.935988 3912 hybrid_clock.cc:648] HybridClock initialized: now 1786337605935955 us; error 47 us; skew 500 ppm
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:25.940088 3912 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:53:25.940783 3912 webserver.cc:460] Webserver started at http://127.15.239.193:42339/ using document root <none> and password file <none>
I20260810 04:53:25.941128 3912 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:25.941216 3912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:53:25 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:25.965710 3912 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 04:53:25.968458 3977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:25.968681 3912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 04:53:25.968792 3912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "dda785eda31447698c5112c8448334bf"
format_stamp: "Formatted at 2026-08-10 04:53:24 on dist-test-slave-kvfs"
server_key: "7818aa8e2b215343dc49d766042f8468"
server_key_iv: "a60c358edd43dc7a4954335c9855f64f"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:25.969404 3912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:26.000741 3912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:26.003947 3912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:26.004186 3912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:26.004504 3912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:26.004908 3912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:26.004949 3912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.004992 3912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:26.005015 3912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.012944 3912 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:37247
I20260810 04:53:26.013712 3912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:53:26.014811 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 3912
I20260810 04:53:26.015161 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:33697
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:32927
--webserver_port=42655
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:53:26.020525 4149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:37247 every 8 connection(s)
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337605, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:26.043855 4154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.021415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:32927 (local address 127.15.239.193:44637)
0810 04:53:26.021923 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:26.021978 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:26.022877 (+ 899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:26.023888 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:26.023894 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:26.024236 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:26.024616 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:26.024622 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.026593 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.026595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:26.028205 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:26.028209 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.029425 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.029427 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:26.029610 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.030401 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:26.030415 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:26.038135 (+ 7720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:26.041258 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:26.041274 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:26.041278 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:26.041733 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:26.042148 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:26.042150 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:26.042151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:26.042381 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:26.042985 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:26.042993 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:26.043199 (+ 206us) client_negotiation.cc:769] Sending connection context
0810 04:53:26.043317 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:53:26.043538 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":115,"threads_started":1}
I20260810 04:53:26.044945 4157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.021497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:44637 (local address 127.15.239.254:32927)
0810 04:53:26.023166 (+ 1669us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:26.023178 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:26.023228 (+ 50us) server_negotiation.cc:407] Connection header received
0810 04:53:26.023439 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:26.023447 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:26.023520 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:26.023687 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:26.024781 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.026446 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.028334 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.029110 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.029240 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.038389 (+ 9149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:26.038398 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:26.038399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:26.038421 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:26.041112 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.041874 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.041880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.041881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.042054 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.042478 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.042479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.042479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.042896 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:26.043000 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:26.044524 (+ 1524us) server_negotiation.cc:299] Negotiation successful
0810 04:53:26.044697 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1590,"thread_start_us":97,"threads_started":1}
I20260810 04:53:26.046379 4150 heartbeater.cc:347] Connected to a master server at 127.15.239.254:32927
I20260810 04:53:26.046507 4150 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.046772 4150 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
W20260810 04:53:26.047971 4150 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:32927 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:53:26.048091 4150 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.048171 4150 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:26.048642 4150 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.048727 4150 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
W20260810 04:53:26.049108 4150 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:53:26.142865 4153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:26.143262 4153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:26.143294 4153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:26.145357 4153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:26.145428 4153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:26.145463 4153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:53:26.148129 4153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:33697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=42655
--tserver_master_addrs=127.15.239.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:26.148464 4153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:26.148815 4153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:26.156375 4164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:26.156380 4165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:26.157768 4153 server_base.cc:1034] running on GCE node
W20260810 04:53:26.159264 4168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:26.159561 4153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:26.159982 4153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:26.161203 4153 hybrid_clock.cc:648] HybridClock initialized: now 1786337606161174 us; error 45 us; skew 500 ppm
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337606, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:26.165179 4153 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:53:26.165849 4153 webserver.cc:460] Webserver started at http://127.15.239.194:42655/ using document root <none> and password file <none>
I20260810 04:53:26.166170 4153 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:26.166268 4153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337606, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:26.199869 4153 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.001s sys 0.000s
I20260810 04:53:26.201259 4183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.201574 4153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:26.201713 4153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "5384ee59a771479e91a0548195c31839"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "716c436b14b8f2cc2fbb12bd02d9846d"
server_key_iv: "0b96fce30d63371aa9dea4a627ed42ff"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:26.202370 4153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:26.211795 4153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:26.214202 4153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:26.214402 4153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:26.214732 4153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:26.215193 4153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:26.215252 4153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.215298 4153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:26.215325 4153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.224399 4153 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:33697
I20260810 04:53:26.224771 4351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:33697 every 8 connection(s)
I20260810 04:53:26.225037 4153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:53:26.226192 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 4153
I20260810 04:53:26.226521 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.239.212:46663/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:39329
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:32927
--webserver_port=44115
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337606, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:26.240240 4157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.226131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:60405 (local address 127.15.239.254:32927)
0810 04:53:26.226196 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:26.226200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:26.226628 (+ 428us) server_negotiation.cc:407] Connection header received
0810 04:53:26.228569 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:26.228572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:26.228595 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:26.228632 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:26.229769 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.230640 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.232451 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.232795 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.232861 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.236099 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:26.236101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:26.236102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:26.236114 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:26.238121 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.238798 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.238800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.238800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.238873 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.239224 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.239225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.239225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.239400 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:26.239462 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:26.239907 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 04:53:26.240091 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 04:53:26.240962 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.226144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:32927 (local address 127.15.239.194:60405)
0810 04:53:26.226465 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:26.226518 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:26.228405 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:26.228900 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:26.228906 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:26.229235 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:26.229600 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:26.229608 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.230788 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.230789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:26.232317 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:26.232321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.233028 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.233029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:26.233203 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.233963 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:26.233978 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:26.235917 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:26.238295 (+ 2378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:26.238306 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:26.238310 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:26.238695 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:26.238943 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:26.238944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:26.238944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:26.239134 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:26.239503 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:26.239512 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:26.239726 (+ 214us) client_negotiation.cc:769] Sending connection context
0810 04:53:26.240441 (+ 715us) client_negotiation.cc:240] Negotiation successful
0810 04:53:26.240660 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":105,"threads_started":1}
I20260810 04:53:26.241819 4352 heartbeater.cc:347] Connected to a master server at 127.15.239.254:32927
I20260810 04:53:26.241959 4352 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.242273 4352 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
W20260810 04:53:26.243129 4352 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:32927 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:53:26.243227 4352 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.243320 4352 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:26.243647 4352 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.243736 4352 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
W20260810 04:53:26.244084 4352 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:53:26.370371 4360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:26.370761 4360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:26.370805 4360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:26.372941 4360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:26.373080 4360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:26.373139 4360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:53:26.375908 4360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.239.212:46663/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:39329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=44115
--tserver_master_addrs=127.15.239.254:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:26.376297 4360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:26.376669 4360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:26.383968 4375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:26.384119 4369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:26.384009 4370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:26.384408 4360 server_base.cc:1034] running on GCE node
I20260810 04:53:26.384671 4360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:26.385006 4360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:26.386202 4360 hybrid_clock.cc:648] HybridClock initialized: now 1786337606386175 us; error 44 us; skew 500 ppm
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337606, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:26.389668 4360 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:53:26.390326 4360 webserver.cc:460] Webserver started at http://127.15.239.195:44115/ using document root <none> and password file <none>
I20260810 04:53:26.390646 4360 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:26.390715 4360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337606, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:26.416636 4360 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260810 04:53:26.420648 4383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.420907 4360 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260810 04:53:26.421023 4360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "3c42e05f2f704ceea5baec34f724c445"
format_stamp: "Formatted at 2026-08-10 04:53:25 on dist-test-slave-kvfs"
server_key: "6b53c22d31abaa0f7083583b30a4cdfe"
server_key_iv: "55805df8ddd3f54fec3521dfb737247a"
server_key_version: "kuduclusterkey@0"
I20260810 04:53:26.421617 4360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:26.449506 4360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:26.451889 4360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:26.452111 4360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:26.452448 4360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:26.452927 4360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:26.452982 4360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.453030 4360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:26.453058 4360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:26.462096 4360 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:39329
I20260810 04:53:26.462133 4559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:39329 every 8 connection(s)
I20260810 04:53:26.462713 4360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:53:26.469547 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 4360
Aug 10 04:53:26 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337606, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:26.476161 4564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.463747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:32927 (local address 127.15.239.195:44649)
0810 04:53:26.463952 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:26.463997 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:26.464907 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:26.465285 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:26.465290 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:26.465613 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:26.466005 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:26.466015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.466838 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.466839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:26.467860 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:26.467864 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.468461 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.468462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:26.468619 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.469378 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:26.469391 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:26.471750 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:26.474032 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:26.474043 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:26.474047 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:26.474413 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:26.474663 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:26.474665 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:26.474665 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:26.474865 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:26.475162 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:26.475172 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:26.475458 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 04:53:26.475599 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 04:53:26.475817 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":109,"threads_started":1}
I20260810 04:53:26.476719 4157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.463739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:44649 (local address 127.15.239.254:32927)
0810 04:53:26.463814 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:26.463821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:26.464141 (+ 320us) server_negotiation.cc:407] Connection header received
0810 04:53:26.465104 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:26.465106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:26.465124 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:26.465189 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:26.466148 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.466724 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.467965 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.468257 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.468351 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.471875 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:26.471877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:26.471877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:26.471887 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:26.473896 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.474504 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.474505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.474506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.474572 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.474941 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.474942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.474942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.475100 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:26.475171 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:26.476518 (+ 1347us) server_negotiation.cc:299] Negotiation successful
0810 04:53:26.476616 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:53:26.477209 4560 heartbeater.cc:347] Connected to a master server at 127.15.239.254:32927
I20260810 04:53:26.477352 4560 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.477636 4560 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
W20260810 04:53:26.478644 4560 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:32927 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:53:26.478744 4560 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.478839 4560 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:26.479324 4560 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:26.479414 4560 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
W20260810 04:53:26.479861 4560 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:53:26.480832 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:26.470057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41882 (local address 127.15.239.254:32927)
0810 04:53:26.470614 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:26.470616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:26.470871 (+ 255us) server_negotiation.cc:407] Connection header received
0810 04:53:26.470898 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:26.470899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:26.470915 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:26.470976 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:26.472830 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.473708 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.474858 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:26.475270 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:26.475357 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:26.477231 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:26.477234 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:26.477234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:26.477242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:26.479303 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.479842 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.479843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.479844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.479915 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:26.480210 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:26.480211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:26.480212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:26.480349 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:26.480571 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:26.480621 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 04:53:26.480719 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":94,"threads_started":1}
I20260810 04:53:27.049331 4150 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:27.049571 4150 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:27.050182 3859 ts_manager.cc:194] Registered new tserver with Master: dda785eda31447698c5112c8448334bf (127.15.239.193:37247)
I20260810 04:53:27.051433 3859 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:44637
Aug 10 04:53:27 dist-test-slave-kvfs krb5kdc[2372](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786337607, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:27.244333 4352 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:27.244787 4352 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:27.246483 3859 ts_manager.cc:194] Registered new tserver with Master: 5384ee59a771479e91a0548195c31839 (127.15.239.194:33697)
I20260810 04:53:27.247143 3859 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:60405
I20260810 04:53:27.480113 4560 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:27.480356 4560 heartbeater.cc:511] Master 127.15.239.254:32927 requested a full tablet report, sending...
I20260810 04:53:27.480883 3859 ts_manager.cc:194] Registered new tserver with Master: 3c42e05f2f704ceea5baec34f724c445 (127.15.239.195:39329)
I20260810 04:53:27.481492 3859 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:44649
I20260810 04:53:27.489054 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:53:27.503513 4596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.490363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41898 (local address 127.15.239.254:32927)
0810 04:53:27.490720 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.490723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.490919 (+ 196us) server_negotiation.cc:407] Connection header received
0810 04:53:27.490950 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.490951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.490965 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.491033 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:27.491913 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.492810 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.493945 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.494281 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.494354 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.497409 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:27.497411 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:27.497412 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:27.497421 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:27.501698 (+ 4277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:27.502246 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:27.502247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:27.502248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:27.502328 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:27.502559 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:27.502561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:27.502561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:27.502755 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:27.502886 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.503107 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.503240 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":115,"threads_started":1}
I20260810 04:53:27.506487 3859 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:53:27.509411 3859 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 10 04:53:27 dist-test-slave-kvfs krb5kdc[2372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337607, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for HTTP/127.15.239.212@KRBTEST.COM
I20260810 04:53:27.521322 4611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.513527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:39329 (local address 127.0.0.1:55798)
0810 04:53:27.514333 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:27.514404 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:27.514499 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:27.515153 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:27.515158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:27.515161 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:27.515263 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.515266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.517871 (+ 2605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.517872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.519717 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.519720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.520906 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.520908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.521027 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.521044 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 04:53:27.521124 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:53:27.521217 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":64,"thread_start_us":109,"threads_started":1}
I20260810 04:53:27.521529 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.514215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56920 (local address 127.15.239.194:33697)
0810 04:53:27.514520 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.514524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.516491 (+ 1967us) server_negotiation.cc:407] Connection header received
0810 04:53:27.516539 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.516542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.516561 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.516637 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:27.517102 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.518154 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.519466 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.520711 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.520790 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.520863 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.521337 (+ 474us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.521412 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":69,"threads_started":1}
I20260810 04:53:27.521744 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.513552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:33697 (local address 127.0.0.1:56920)
0810 04:53:27.514727 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:27.516333 (+ 1606us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:27.516416 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:27.516938 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:27.516939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:27.516941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:27.517009 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.517011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.518249 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.518250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.519366 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.519370 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.520909 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.520910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.521027 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.521044 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 04:53:27.521124 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:53:27.521678 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1157,"mutex_wait_us":487,"thread_start_us":85,"threads_started":1}
I20260810 04:53:27.522580 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.514013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55798 (local address 127.15.239.195:39329)
0810 04:53:27.514421 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.514431 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.514548 (+ 117us) server_negotiation.cc:407] Connection header received
0810 04:53:27.514606 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.514610 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.514630 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.514721 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:27.515359 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.517761 (+ 2402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.519810 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.520707 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.520790 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.520870 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.522417 (+ 1547us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.522477 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":82,"threads_started":1}
I20260810 04:53:27.523840 4453 tablet_service.cc:1467] Processing CreateTablet for tablet 710937c756e749c084508618c4ccf7d3 (DEFAULT_TABLE table=test-table [id=bbcb4dd4897e406d95833565ab99ab2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:27.524433 4453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710937c756e749c084508618c4ccf7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:27.528167 4256 tablet_service.cc:1467] Processing CreateTablet for tablet 710937c756e749c084508618c4ccf7d3 (DEFAULT_TABLE table=test-table [id=bbcb4dd4897e406d95833565ab99ab2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:27.528690 4256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710937c756e749c084508618c4ccf7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:27.529656 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.513820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:37247 (local address 127.0.0.1:51114)
0810 04:53:27.514847 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:27.514857 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:27.514916 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:27.516244 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:27.516246 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:27.516251 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:27.516325 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.516327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.526339 (+ 10012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.526341 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.527870 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.527874 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.529318 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.529320 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.529426 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.529433 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 04:53:27.529492 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 04:53:27.529553 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"thread_start_us":83,"threads_started":1}
I20260810 04:53:27.529965 4615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.514081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51114 (local address 127.15.239.193:37247)
0810 04:53:27.514670 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.514674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.516009 (+ 1335us) server_negotiation.cc:407] Connection header received
0810 04:53:27.516090 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.516093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.516116 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.516225 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:27.516449 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.517766 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.528054 (+ 10288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.529097 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.529194 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.529271 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.529794 (+ 523us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.529870 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":79,"threads_started":1}
I20260810 04:53:27.532961 4050 tablet_service.cc:1467] Processing CreateTablet for tablet 710937c756e749c084508618c4ccf7d3 (DEFAULT_TABLE table=test-table [id=bbcb4dd4897e406d95833565ab99ab2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:27.533434 4050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710937c756e749c084508618c4ccf7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:27.540843 4619 tablet_bootstrap.cc:492] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Bootstrap starting.
I20260810 04:53:27.541877 4619 tablet_bootstrap.cc:654] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:27.542171 4618 tablet_bootstrap.cc:492] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf: Bootstrap starting.
I20260810 04:53:27.543040 4618 tablet_bootstrap.cc:654] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:27.543562 4619 log.cc:824] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:27.544014 4618 log.cc:824] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:27.544823 4617 tablet_bootstrap.cc:492] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Bootstrap starting.
I20260810 04:53:27.545440 4618 tablet_bootstrap.cc:492] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf: No bootstrap required, opened a new log
I20260810 04:53:27.545547 4618 ts_tablet_manager.cc:1397] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:53:27.548346 4618 raft_consensus.cc:348] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.549755 4617 tablet_bootstrap.cc:654] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:27.550225 4617 log.cc:824] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:27.550637 4618 raft_consensus.cc:374] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:27.550771 4618 raft_consensus.cc:729] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda785eda31447698c5112c8448334bf, State: Initialized, Role: FOLLOWER
I20260810 04:53:27.551072 4618 consensus_queue.cc:260] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.551604 4618 ts_tablet_manager.cc:1428] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 04:53:27.552269 4150 heartbeater.cc:503] Master 127.15.239.254:32927 was elected leader, sending a full tablet report...
I20260810 04:53:27.554124 4619 tablet_bootstrap.cc:492] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: No bootstrap required, opened a new log
I20260810 04:53:27.554291 4619 ts_tablet_manager.cc:1397] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260810 04:53:27.556998 4617 tablet_bootstrap.cc:492] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: No bootstrap required, opened a new log
I20260810 04:53:27.557188 4617 ts_tablet_manager.cc:1397] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260810 04:53:27.557766 4619 raft_consensus.cc:348] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.558135 4619 raft_consensus.cc:374] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:27.558243 4619 raft_consensus.cc:729] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5384ee59a771479e91a0548195c31839, State: Initialized, Role: FOLLOWER
I20260810 04:53:27.558499 4619 consensus_queue.cc:260] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.558966 4619 ts_tablet_manager.cc:1428] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 04:53:27.559195 4352 heartbeater.cc:503] Master 127.15.239.254:32927 was elected leader, sending a full tablet report...
I20260810 04:53:27.560120 4617 raft_consensus.cc:348] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.560372 4617 raft_consensus.cc:374] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:27.560427 4617 raft_consensus.cc:729] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c42e05f2f704ceea5baec34f724c445, State: Initialized, Role: FOLLOWER
I20260810 04:53:27.560586 4617 consensus_queue.cc:260] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.560914 4617 ts_tablet_manager.cc:1428] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 04:53:27.568176 4560 heartbeater.cc:503] Master 127.15.239.254:32927 was elected leader, sending a full tablet report...
I20260810 04:53:27.585906 4624 raft_consensus.cc:482] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:27.586254 4624 raft_consensus.cc:504] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.587731 4624 leader_election.cc:288] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c42e05f2f704ceea5baec34f724c445 (127.15.239.195:39329), 5384ee59a771479e91a0548195c31839 (127.15.239.194:33697)
I20260810 04:53:27.591777 4613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.587386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:36965 (local address 127.15.239.195:39329)
0810 04:53:27.587450 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.587453 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.588070 (+ 617us) server_negotiation.cc:407] Connection header received
0810 04:53:27.588181 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.588183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.588195 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.588228 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:27.588447 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.589168 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.590703 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.591318 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.591368 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.591379 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.591631 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.591685 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 04:53:27.592322 4616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.587543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:42387 (local address 127.15.239.194:33697)
0810 04:53:27.587702 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.587704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.587786 (+ 82us) server_negotiation.cc:407] Connection header received
0810 04:53:27.587918 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.587920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.587934 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.587971 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:27.588290 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.589150 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.591220 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.591818 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.591890 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.591901 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.592178 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.592228 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260810 04:53:27.592595 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.587225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:33697 (local address 127.15.239.193:42387)
0810 04:53:27.587706 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:27.587720 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:27.587823 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:27.588093 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:27.588094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:27.588096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:27.588202 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.588206 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.589285 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.589285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.591114 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.591117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.591986 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.591987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.592096 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.592100 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:53:27.592464 (+ 364us) client_negotiation.cc:240] Negotiation successful
0810 04:53:27.592505 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":76,"thread_start_us":151,"threads_started":1}
I20260810 04:53:27.592600 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.587225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:39329 (local address 127.15.239.193:36965)
0810 04:53:27.587974 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:27.587988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:27.588097 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:27.588304 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:27.588304 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:27.588306 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:27.588368 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.588369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.589274 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.589275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.590597 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:27.590602 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.591468 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.591469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:27.591550 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.591554 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:53:27.592244 (+ 690us) client_negotiation.cc:240] Negotiation successful
0810 04:53:27.592299 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":338,"thread_start_us":120,"threads_started":1}
I20260810 04:53:27.593137 4283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710937c756e749c084508618c4ccf7d3" candidate_uuid: "dda785eda31447698c5112c8448334bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5384ee59a771479e91a0548195c31839" is_pre_election: true
I20260810 04:53:27.593410 4283 raft_consensus.cc:2454] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda785eda31447698c5112c8448334bf in term 0.
I20260810 04:53:27.593365 4468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710937c756e749c084508618c4ccf7d3" candidate_uuid: "dda785eda31447698c5112c8448334bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c42e05f2f704ceea5baec34f724c445" is_pre_election: true
I20260810 04:53:27.593577 4468 raft_consensus.cc:2454] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda785eda31447698c5112c8448334bf in term 0.
I20260810 04:53:27.593709 3981 leader_election.cc:302] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5384ee59a771479e91a0548195c31839, dda785eda31447698c5112c8448334bf; no voters:
I20260810 04:53:27.593865 4624 raft_consensus.cc:2781] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:53:27.593930 4624 raft_consensus.cc:482] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:53:27.593958 4624 raft_consensus.cc:3037] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:27.595139 4624 raft_consensus.cc:504] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.595378 4624 leader_election.cc:288] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [CANDIDATE]: Term 1 election: Requested vote from peers 3c42e05f2f704ceea5baec34f724c445 (127.15.239.195:39329), 5384ee59a771479e91a0548195c31839 (127.15.239.194:33697)
I20260810 04:53:27.595554 4468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710937c756e749c084508618c4ccf7d3" candidate_uuid: "dda785eda31447698c5112c8448334bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c42e05f2f704ceea5baec34f724c445"
I20260810 04:53:27.595660 4468 raft_consensus.cc:3037] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:27.595710 4283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710937c756e749c084508618c4ccf7d3" candidate_uuid: "dda785eda31447698c5112c8448334bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5384ee59a771479e91a0548195c31839"
I20260810 04:53:27.595805 4283 raft_consensus.cc:3037] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:27.596877 4283 raft_consensus.cc:2454] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda785eda31447698c5112c8448334bf in term 1.
I20260810 04:53:27.596877 4468 raft_consensus.cc:2454] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda785eda31447698c5112c8448334bf in term 1.
I20260810 04:53:27.597093 3982 leader_election.cc:302] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c42e05f2f704ceea5baec34f724c445, dda785eda31447698c5112c8448334bf; no voters:
I20260810 04:53:27.597184 4624 raft_consensus.cc:2781] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:27.597388 4624 raft_consensus.cc:686] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [term 1 LEADER]: Becoming Leader. State: Replica: dda785eda31447698c5112c8448334bf, State: Running, Role: LEADER
I20260810 04:53:27.597527 4624 consensus_queue.cc:237] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } }
I20260810 04:53:27.598639 3859 catalog_manager.cc:5495] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf reported cstate change: term changed from 0 to 1, leader changed from <none> to dda785eda31447698c5112c8448334bf (127.15.239.193). New cstate: current_term: 1 leader_uuid: "dda785eda31447698c5112c8448334bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda785eda31447698c5112c8448334bf" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37247 } health_report { overall_health: HEALTHY } } }
I20260810 04:53:27.615877 4615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.611962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51116 (local address 127.15.239.193:37247)
0810 04:53:27.612060 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:27.612063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:27.612077 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:53:27.612135 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:27.612137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:27.612166 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:27.612276 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:53:27.612496 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.613308 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.614547 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:27.614859 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:27.614936 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:27.615161 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:53:27.615336 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:53:27.615441 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:27.615729 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 04:53:27.615760 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:53:27.619189 4283 raft_consensus.cc:1261] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 1 FOLLOWER]: Refusing update from remote peer dda785eda31447698c5112c8448334bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:27.619650 4624 consensus_queue.cc:1035] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5384ee59a771479e91a0548195c31839" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 33697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:27.622725 4468 raft_consensus.cc:1261] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 1 FOLLOWER]: Refusing update from remote peer dda785eda31447698c5112c8448334bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:27.623097 4624 consensus_queue.cc:1035] T 710937c756e749c084508618c4ccf7d3 P dda785eda31447698c5112c8448334bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c42e05f2f704ceea5baec34f724c445" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 39329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:27.628121 4639 mvcc.cc:205] Tried to move back new op lower bound from 7316838840803926016 to 7316838840720261120. Current Snapshot: MvccSnapshot[applied={T|T < 7316838840803926016}]
I20260810 04:53:27.628382 4645 mvcc.cc:205] Tried to move back new op lower bound from 7316838840803926016 to 7316838840720261120. Current Snapshot: MvccSnapshot[applied={T|T < 7316838840803926016}]
I20260810 04:53:27.631771 4640 mvcc.cc:205] Tried to move back new op lower bound from 7316838840803926016 to 7316838840720261120. Current Snapshot: MvccSnapshot[applied={T|T < 7316838840803926016}]
I20260810 04:53:27.639184 3857 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:27.639374 3857 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:27.640385 3857 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d38acd0586945348f6ae1ab7bcffa55: Sending DeleteTablet for 3 replicas of tablet 710937c756e749c084508618c4ccf7d3
I20260810 04:53:27.641108 4256 tablet_service.cc:1514] Processing DeleteTablet for tablet 710937c756e749c084508618c4ccf7d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:27 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:56920
I20260810 04:53:27.641165 4453 tablet_service.cc:1514] Processing DeleteTablet for tablet 710937c756e749c084508618c4ccf7d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:27 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:55798
I20260810 04:53:27.641460 4050 tablet_service.cc:1514] Processing DeleteTablet for tablet 710937c756e749c084508618c4ccf7d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:27 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:51114
I20260810 04:53:27.641987 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 3912
I20260810 04:53:27.652228 4653 tablet_replica.cc:330] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: stopping tablet replica
I20260810 04:53:27.652526 4653 raft_consensus.cc:2229] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:27.652796 4653 raft_consensus.cc:2258] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:27.653121 4656 tablet_replica.cc:330] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: stopping tablet replica
I20260810 04:53:27.653317 4656 raft_consensus.cc:2229] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:27.653497 4656 raft_consensus.cc:2258] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:27.656540 4656 ts_tablet_manager.cc:1905] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:27.659238 4656 ts_tablet_manager.cc:1918] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:27.659356 4656 log.cc:1196] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/710937c756e749c084508618c4ccf7d3
I20260810 04:53:27.659682 4656 ts_tablet_manager.cc:1939] T 710937c756e749c084508618c4ccf7d3 P 3c42e05f2f704ceea5baec34f724c445: Deleting consensus metadata
I20260810 04:53:27.660863 3839 catalog_manager.cc:4841] TS 3c42e05f2f704ceea5baec34f724c445 (127.15.239.195:39329): tablet 710937c756e749c084508618c4ccf7d3 (table test-table [id=bbcb4dd4897e406d95833565ab99ab2d]) successfully deleted
I20260810 04:53:27.666359 4653 ts_tablet_manager.cc:1905] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:27.668622 4653 ts_tablet_manager.cc:1918] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:27.668730 4653 log.cc:1196] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/710937c756e749c084508618c4ccf7d3
I20260810 04:53:27.669070 4653 ts_tablet_manager.cc:1939] T 710937c756e749c084508618c4ccf7d3 P 5384ee59a771479e91a0548195c31839: Deleting consensus metadata
I20260810 04:53:27.669710 3838 catalog_manager.cc:4841] TS 5384ee59a771479e91a0548195c31839 (127.15.239.194:33697): tablet 710937c756e749c084508618c4ccf7d3 (table test-table [id=bbcb4dd4897e406d95833565ab99ab2d]) successfully deleted
W20260810 04:53:27.673199 3836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:37247 (error 108)
I20260810 04:53:27.674348 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:27.674190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:37247 (local address 127.0.0.1:51126)
0810 04:53:27.674252 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:27.674289 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:37247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 04:53:27.674485 3836 catalog_manager.cc:4584] TS dda785eda31447698c5112c8448334bf (127.15.239.193:37247): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 710937c756e749c084508618c4ccf7d3: Network error: Client connection negotiation failed: client connection to 127.15.239.193:37247: connect: Connection refused (error 111)
I20260810 04:53:27.674736 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 4153
I20260810 04:53:27.689128 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 4360
I20260810 04:53:27.703917 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 3802
I20260810 04:53:27.721419 16319 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 04:53:28.067248 16319 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 04:53:28.067380 16319 mini_ranger.cc:66] Stopping Ranger...
I20260810 04:53:28.412623 16319 mini_ranger.cc:68] Stopped Ranger
2026-08-10 04:53:28.413 UTC [2415] LOG: received smart shutdown request
2026-08-10 04:53:28.418 UTC [2415] LOG: background worker "logical replication launcher" (PID 2425) exited with exit code 1
2026-08-10 04:53:28.419 UTC [2419] LOG: shutting down
2026-08-10 04:53:28.621 UTC [2415] LOG: database system is shut down
2026-08-10T04:53:28Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54212 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:53:28 dist-test-slave-kvfs krb5kdc[4672](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:53:28 dist-test-slave-kvfs krb5kdc[4672](info): set up 2 sockets
Aug 10 04:53:28 dist-test-slave-kvfs krb5kdc[4672](info): commencing operation
krb5kdc: starting...
W20260810 04:53:30.046449 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:53:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:53:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:53:30.192072 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:46027
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:46027,127.15.239.253:45997,127.15.239.252:42781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:30.291641 4692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:30.291972 4692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:30.292017 4692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:30.293349 4692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:30.293435 4692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:30.293459 4692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:30.293481 4692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:30.293509 4692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:30.295387 4692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:46027,127.15.239.253:45997,127.15.239.252:42781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:46027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:30.295740 4692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:30.296103 4692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:30.301997 4701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:30.301966 4705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:30.301962 4698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:30.302266 4692 server_base.cc:1034] running on GCE node
I20260810 04:53:30.302606 4692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:30.303054 4692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:30.304205 4692 hybrid_clock.cc:648] HybridClock initialized: now 1786337610304186 us; error 43 us; skew 500 ppm
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:30.307701 4692 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:30.308388 4692 webserver.cc:460] Webserver started at http://127.15.239.254:41197/ using document root <none> and password file <none>
I20260810 04:53:30.308688 4692 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:30.308773 4692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:30.308952 4692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:30.310403 4692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "ecfb63c190134c97a4071329a1b9a65f"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "960851d15566e231000fc97d6c47d332"
server_key_iv: "c633944f7a8bcf4ae748d3b8e8b56f34"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.310809 4692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "ecfb63c190134c97a4071329a1b9a65f"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "960851d15566e231000fc97d6c47d332"
server_key_iv: "c633944f7a8bcf4ae748d3b8e8b56f34"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.312469 4692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 04:53:30.313392 4714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:30.313616 4692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:30.313727 4692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "ecfb63c190134c97a4071329a1b9a65f"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "960851d15566e231000fc97d6c47d332"
server_key_iv: "c633944f7a8bcf4ae748d3b8e8b56f34"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.313800 4692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:30.335631 4692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:30.338514 4692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:30.338658 4692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:30.343609 4692 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:46027
I20260810 04:53:30.343665 4786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:46027 every 8 connection(s)
I20260810 04:53:30.344129 4692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:30.345278 4787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:30.347322 4787 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:53:30.349869 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 4692
I20260810 04:53:30.350018 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:53:30.350242 16319 external_mini_cluster.cc:1428] Setting key bc227bfb7f4cc81b2a25e357466df918
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:30.358952 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.348301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46027 (local address 127.0.0.1:33414)
0810 04:53:30.348549 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.348600 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.349207 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.349542 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.349545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.349889 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.350149 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.350156 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.351350 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.351351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.352199 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.352201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.352870 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.352872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.352967 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.353582 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.353591 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.355137 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.357188 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.357195 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.357198 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.357414 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.357708 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.357709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.357710 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.357810 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.358241 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.358247 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.358322 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.358439 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.358711 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":116,"spinlock_wait_cycles":10624,"thread_start_us":135,"threads_started":1}
I20260810 04:53:30.358958 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.348302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33414 (local address 127.15.239.254:46027)
0810 04:53:30.348560 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.348573 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.348722 (+ 149us) server_negotiation.cc:407] Connection header received
0810 04:53:30.349394 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.349396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.349416 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.349534 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.350273 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.351227 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.352299 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.352753 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.352871 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.355249 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.355257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.355258 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.355265 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.357073 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.357536 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.357539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.357540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.357635 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.357881 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.357882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.357883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.358157 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.358256 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.358465 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.358661 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":194,"thread_start_us":111,"threads_started":1}
I20260810 04:53:30.359840 4787 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:53:30.360345 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.360213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49562)
0810 04:53:30.360267 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.360319 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:53:30.360504 4720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.15.239.253@KRBTEST.COM; defaulting to no policy
I20260810 04:53:30.360999 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.360895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49572)
0810 04:53:30.360938 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.360965 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 04:53:30.361107 4787 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:45997: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab.
Entry for principal kudu/127.15.239.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab.
I20260810 04:53:30.385244 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:45997
--webserver_interface=127.15.239.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab
--principal=kudu/127.15.239.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:46027,127.15.239.253:45997,127.15.239.252:42781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:53:30.410370 4787 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } attempt: 1
I20260810 04:53:30.411125 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.410956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49578)
0810 04:53:30.411034 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.411084 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 04:53:30.411562 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.411450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49584)
0810 04:53:30.411504 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.411538 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 04:53:30.411669 4787 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:45997: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
I20260810 04:53:30.479848 4787 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } attempt: 2
I20260810 04:53:30.480566 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.480376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49600)
0810 04:53:30.480469 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.480521 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 04:53:30.480983 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.480856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49608)
0810 04:53:30.480915 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.480945 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:53:30.481093 4787 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:45997: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45997: connect: Connection refused (error 111)
W20260810 04:53:30.492879 4800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:30.493170 4800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:30.493197 4800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:30.494596 4800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:30.494648 4800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:30.494663 4800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:30.494676 4800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:30.494689 4800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:30.496678 4800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:46027,127.15.239.253:45997,127.15.239.252:42781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab
--principal=kudu/127.15.239.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:45997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.239.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:30.497033 4800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:30.497336 4800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:30.503155 4818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:30.503238 4807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:30.503171 4808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:30.503762 4800 server_base.cc:1034] running on GCE node
I20260810 04:53:30.504184 4800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:30.504552 4800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:30.505744 4800 hybrid_clock.cc:648] HybridClock initialized: now 1786337610505722 us; error 44 us; skew 500 ppm
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:30.509249 4800 init.cc:377] Logged in from keytab as kudu/127.15.239.253@KRBTEST.COM (short username kudu)
I20260810 04:53:30.509851 4800 webserver.cc:460] Webserver started at http://127.15.239.253:41941/ using document root <none> and password file <none>
I20260810 04:53:30.510135 4800 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:30.510187 4800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:30.510388 4800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:30.511689 4800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data/instance:
uuid: "4ab20d9aed714c97868b9646ffa9d446"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "eb2f678b9ff91193c5490f82f320a716"
server_key_iv: "61db8282949ce4aa5d43a19285aa75d6"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.512212 4800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal/instance:
uuid: "4ab20d9aed714c97868b9646ffa9d446"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "eb2f678b9ff91193c5490f82f320a716"
server_key_iv: "61db8282949ce4aa5d43a19285aa75d6"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.514245 4800 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 04:53:30.515316 4827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:30.515698 4800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:30.515843 4800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal
uuid: "4ab20d9aed714c97868b9646ffa9d446"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "eb2f678b9ff91193c5490f82f320a716"
server_key_iv: "61db8282949ce4aa5d43a19285aa75d6"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.515945 4800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:30.530639 4800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:30.533857 4800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:30.534068 4800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:30.540442 4800 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.253:45997
I20260810 04:53:30.540546 4891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.253:45997 every 8 connection(s)
I20260810 04:53:30.540983 4800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
I20260810 04:53:30.542590 4892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:30.543341 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 4800
I20260810 04:53:30.543463 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-1/wal/instance
I20260810 04:53:30.543862 16319 external_mini_cluster.cc:1428] Setting key c1054da1b5d33bb9ef6325a8d90a8d3c
I20260810 04:53:30.546152 4892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.239.252@KRBTEST.COM; defaulting to no policy
I20260810 04:53:30.561940 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.547388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33424 (local address 127.15.239.254:46027)
0810 04:53:30.547503 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.547506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.547870 (+ 364us) server_negotiation.cc:407] Connection header received
0810 04:53:30.548746 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.548747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.548766 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.548832 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.550110 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.550925 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.553332 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.553645 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.553744 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.557106 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.557109 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.557110 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.557125 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.559192 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.559843 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.559844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.559845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.559919 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.560583 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.560585 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.560586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.560742 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.560807 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.561729 (+ 922us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.561842 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.252@KRBTEST.COM" created.
I20260810 04:53:30.562345 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.547355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46027 (local address 127.0.0.1:33424)
0810 04:53:30.547631 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.547698 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.548611 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.548931 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.548936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.549408 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.549797 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.549804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.551108 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.551110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.552931 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.552936 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.553786 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.553788 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.554010 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.554749 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.554838 (+ 89us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.556969 (+ 2131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.559329 (+ 2360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.559340 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.559345 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.559721 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.560329 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.560330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.560330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.560465 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.560886 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.560907 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.561477 (+ 570us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.561640 (+ 163us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.561962 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":143,"threads_started":1}
I20260810 04:53:30.563786 4892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:53:30.572288 4787 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } attempt: 3
I20260810 04:53:30.573671 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.564240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49610)
0810 04:53:30.564303 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.564316 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.564364 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.564799 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.564801 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.565004 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.565086 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.565088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.566343 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.566344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.566898 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.566900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.567441 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.567443 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.567539 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.568093 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.568099 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.569572 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.571997 (+ 2425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.571998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.571999 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.572368 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.572777 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.572779 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.572779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.572864 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.573248 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.573249 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.573293 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.573394 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.573525 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 04:53:30.573741 4897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.564316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49610 (local address 127.15.239.253:45997)
0810 04:53:30.564562 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.564569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.564599 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:53:30.564629 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.564632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.564651 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.564760 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.565178 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.566237 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.566989 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.567328 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.567445 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.569678 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.569690 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.569690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.569700 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.571873 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.572548 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.572553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.572553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.572632 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.572945 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.572946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.572946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.573190 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.573283 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.573449 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.573588 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":199,"thread_start_us":127,"threads_started":1}
I20260810 04:53:30.574700 4892 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:53:30.575234 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.575043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57836)
0810 04:53:30.575131 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.575196 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260810 04:53:30.575407 4830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
I20260810 04:53:30.576290 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.576172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57838)
0810 04:53:30.576226 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.576265 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:53:30.576413 4892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:42781: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:53:30.582624 4902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.572813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49616 (local address 127.15.239.253:45997)
0810 04:53:30.573035 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.573037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.573046 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:53:30.573067 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.573068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.573080 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.573163 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.573622 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.574620 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.575784 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.576093 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.576165 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.578834 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.578836 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.578836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.578844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.581286 (+ 2442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.581716 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.581717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.581718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.581813 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.582031 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.582031 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.582032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.582214 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.582281 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.582458 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.582538 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":134,"threads_started":1}
I20260810 04:53:30.582639 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.572741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49616)
0810 04:53:30.572828 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.572850 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.572903 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.573197 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.573200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.573406 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.573519 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.573522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.574770 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.574772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.575665 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.575670 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.576184 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.576187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.576298 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.576827 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.576831 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.578712 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.581383 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.581384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.581385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.581617 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.581891 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.581892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.581892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.581961 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.582298 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.582300 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.582369 (+ 69us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.582439 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.582555 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 04:53:30.583195 4787 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab.
Entry for principal kudu/127.15.239.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab.
I20260810 04:53:30.583675 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.583530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57854)
0810 04:53:30.583593 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.583634 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 04:53:30.584097 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.583954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57860)
0810 04:53:30.584010 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.584063 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:53:30.584194 4787 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:42781: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
I20260810 04:53:30.584682 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:42781
--webserver_interface=127.15.239.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab
--principal=kudu/127.15.239.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:38489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:46027,127.15.239.253:45997,127.15.239.252:42781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:53:30.615377 4787 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } attempt: 1
I20260810 04:53:30.616161 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.615938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57872)
0810 04:53:30.616047 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.616109 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:53:30.616662 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.616546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57876)
0810 04:53:30.616600 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.616635 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:53:30.616807 4787 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:42781: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
I20260810 04:53:30.625711 4892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } attempt: 1
I20260810 04:53:30.626487 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.626326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57878)
0810 04:53:30.626401 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.626447 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:53:30.626883 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.626781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57888)
0810 04:53:30.626831 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.626857 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:53:30.626989 4892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:42781: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
W20260810 04:53:30.686594 4905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:30.686844 4905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:30.686867 4905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:30.688119 4905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:30.688163 4905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:30.688179 4905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:30.688191 4905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:30.688203 4905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:30.689846 4905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:46027,127.15.239.253:45997,127.15.239.252:42781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab
--principal=kudu/127.15.239.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:42781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.239.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:30.690179 4905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:30.690474 4905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:53:30.692070 4787 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } attempt: 2
I20260810 04:53:30.692684 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.692527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57892)
0810 04:53:30.692599 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.692646 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 04:53:30.693089 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.692987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57908)
0810 04:53:30.693037 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.693070 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:53:30.693188 4787 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:42781: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
I20260810 04:53:30.695215 4892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } attempt: 2
I20260810 04:53:30.695797 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.695621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57910)
0810 04:53:30.695694 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.695753 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 04:53:30.696249 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.696149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57924)
0810 04:53:30.696186 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.696218 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260810 04:53:30.696352 4892 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:42781: Network error: Client connection negotiation failed: client connection to 127.15.239.252:42781: connect: Connection refused (error 111)
W20260810 04:53:30.696323 4913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:30.696565 4912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:30.696576 4905 server_base.cc:1034] running on GCE node
W20260810 04:53:30.696664 4916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:30.696942 4905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:30.697328 4905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:30.698503 4905 hybrid_clock.cc:648] HybridClock initialized: now 1786337610698488 us; error 32 us; skew 500 ppm
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:30.701529 4905 init.cc:377] Logged in from keytab as kudu/127.15.239.252@KRBTEST.COM (short username kudu)
I20260810 04:53:30.702108 4905 webserver.cc:460] Webserver started at http://127.15.239.252:37771/ using document root <none> and password file <none>
I20260810 04:53:30.702400 4905 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:30.702474 4905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:30.702651 4905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:30.703910 4905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data/instance:
uuid: "58180fd38926457b88169296a88252cf"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "15efbfaf47daccb596d8753b697b4b0a"
server_key_iv: "c762c88a362332d4f2ecaafab60c9f74"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.704389 4905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal/instance:
uuid: "58180fd38926457b88169296a88252cf"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "15efbfaf47daccb596d8753b697b4b0a"
server_key_iv: "c762c88a362332d4f2ecaafab60c9f74"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.705899 4905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:53:30.706719 4926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:30.706907 4905 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:30.707028 4905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal
uuid: "58180fd38926457b88169296a88252cf"
format_stamp: "Formatted at 2026-08-10 04:53:30 on dist-test-slave-kvfs"
server_key: "15efbfaf47daccb596d8753b697b4b0a"
server_key_iv: "c762c88a362332d4f2ecaafab60c9f74"
server_key_version: "encryptionkey@0"
I20260810 04:53:30.707111 4905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:30.726425 4905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:30.728829 4905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:30.729023 4905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:30.733786 4905 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.252:42781
I20260810 04:53:30.733846 5005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.252:42781 every 8 connection(s)
I20260810 04:53:30.734308 4905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
I20260810 04:53:30.735415 5007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:30.737363 5007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:53:30.742524 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 4905
I20260810 04:53:30.742616 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786337435403234-16319-0/minicluster-data/master-2/wal/instance
I20260810 04:53:30.742830 16319 external_mini_cluster.cc:1428] Setting key 3fc595856df0e69fbcf25f1143516120
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:30.748217 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.738259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33426 (local address 127.15.239.254:46027)
0810 04:53:30.738332 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.738334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.738593 (+ 259us) server_negotiation.cc:407] Connection header received
0810 04:53:30.739182 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.739184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.739200 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.739261 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.740055 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.740611 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.741725 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.741937 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.742084 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.744850 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.744852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.744853 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.744861 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.746399 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.746950 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.746954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.746958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.747059 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.747333 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.747335 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.747335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.747528 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.747616 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.747974 (+ 358us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.748115 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:53:30.748404 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.738215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46027 (local address 127.0.0.1:33426)
0810 04:53:30.738438 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.738483 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.739050 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.739369 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.739373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.739675 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.739914 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.739918 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.740717 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.740719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.741614 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.741617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.742090 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.742091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.742257 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.742961 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.742985 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.744754 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.746538 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.746547 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.746549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.746868 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.747142 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.747143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.747144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.747258 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.747630 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.747637 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.747776 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.747903 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.748109 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":105,"threads_started":1}
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:53:30.749125 5007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:53:30.752970 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.743331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57940 (local address 127.15.239.252:42781)
0810 04:53:30.743526 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.743530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.743622 (+ 92us) server_negotiation.cc:407] Connection header received
0810 04:53:30.743688 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.743691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.743713 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.743813 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.744592 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.745296 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.746069 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.746394 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.746480 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.749531 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.749540 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.749540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.749547 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.751516 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.751938 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.751942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.751942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.752002 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.752279 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.752280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.752280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.752461 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.752629 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.752720 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.752811 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:53:30.757472 4902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.749545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49622 (local address 127.15.239.253:45997)
0810 04:53:30.749593 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.749595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.749603 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:53:30.749633 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.749634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.749652 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.749700 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.750095 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.750852 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.751825 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.752227 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.752313 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.754407 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.754409 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.754410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.754418 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.756250 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.756631 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.756632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.756632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.756701 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.756911 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.756912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.756912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.757043 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.757116 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.757283 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.757364 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:53:30.757472 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.749455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45997 (local address 127.0.0.1:49622)
0810 04:53:30.749509 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.749520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.749563 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.749721 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.749722 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.749880 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.749937 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.749939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.750950 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.750952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.751742 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.751744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.752311 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.752312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.752410 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.752840 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.752845 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.754305 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.756334 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.756335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.756336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.756534 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.756770 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.756771 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.756771 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.756837 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.757121 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.757122 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.757170 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.757256 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.757362 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:53:30.757869 5007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:53:30.762841 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.754129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33438 (local address 127.15.239.254:46027)
0810 04:53:30.754219 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.754221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.754230 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:53:30.754254 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.754255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.754266 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.754339 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.754967 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.755764 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.756614 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.756824 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.756913 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.759672 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.759674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.759674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.759691 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.761341 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.761799 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.761801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.761801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.761882 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.762177 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.762178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.762179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.762337 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.762605 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.762650 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.762724 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 04:53:30.765735 5010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.758179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57952)
0810 04:53:30.758278 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.758289 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.758338 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.758450 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.758451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.758601 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.758645 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.758647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.759449 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.759450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.760180 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.760183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.760704 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.760706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.760770 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.761164 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.761169 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.762750 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.764578 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.764579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.764579 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.764812 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.765030 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.765030 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.765031 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.765096 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.765357 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.765358 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.765400 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.765493 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.765611 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260810 04:53:30.765741 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.758243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57952 (local address 127.15.239.252:42781)
0810 04:53:30.758281 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.758283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.758322 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:53:30.758386 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.758387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.758396 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.758440 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.758730 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.759285 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.760263 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.760616 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.760702 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.762847 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.762848 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.762849 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.762856 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.764495 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.764891 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.764892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.764892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.764944 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.765162 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.765163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.765163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.765285 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.765365 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.765522 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.765661 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":17}
I20260810 04:53:30.767789 5007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf: Bootstrap starting.
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:53:30.769239 5007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:30.769649 5007 log.cc:824] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:30.770701 5007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf: No bootstrap required, opened a new log
I20260810 04:53:30.772194 4902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.764138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49628 (local address 127.15.239.253:45997)
0810 04:53:30.764212 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.764214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.764220 (+ 6us) server_negotiation.cc:407] Connection header received
0810 04:53:30.764243 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.764244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.764253 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.764319 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.764965 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.765470 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.766418 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.766633 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.766710 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.769429 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.769430 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.769431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.769438 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.771020 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.771395 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.771396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.771396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.771458 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.771668 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.771668 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.771669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.771774 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.771930 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.771986 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.772107 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:53:30.773411 5007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.773634 5007 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:30.773687 5007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58180fd38926457b88169296a88252cf, State: Initialized, Role: FOLLOWER
I20260810 04:53:30.773842 5007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.773980 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:53:30.774187 5015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.774256 5007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:30.774304 5015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:53:30.776583 5041 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:53:30.776655 5041 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:53:30.776847 4905 master_runner.cc:186] Error getting master registration for 127.15.239.254:46027: OK, instance_id { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" instance_seqno: 1786337610342263 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:53:30.780180 4905 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:53:30.785838 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.776237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33444 (local address 127.15.239.254:46027)
0810 04:53:30.776695 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.776697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.776708 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:53:30.776732 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.776733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.776744 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.776804 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.777528 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.778356 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.779506 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.779813 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.779864 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.782200 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.782202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.782202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.782212 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.784380 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.784825 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.784826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.784827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.784898 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.785147 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.785148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.785149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.785323 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.785459 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.785610 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.785719 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430}
I20260810 04:53:30.787519 4892 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } attempt: 3
I20260810 04:53:30.787709 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.776183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57954 (local address 127.15.239.252:42781)
0810 04:53:30.776287 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.776289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.776428 (+ 139us) server_negotiation.cc:407] Connection header received
0810 04:53:30.776571 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.776572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.776584 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.776615 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.777658 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.778370 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.780289 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.780934 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.781020 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.783178 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.783179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.783179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.783187 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.785251 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.785879 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.785880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.785881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.785941 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.787061 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.787062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.787063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.787233 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.787344 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.787471 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.787573 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 04:53:30.788987 4902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.776252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49644 (local address 127.15.239.253:45997)
0810 04:53:30.776291 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.776293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.777210 (+ 917us) server_negotiation.cc:407] Connection header received
0810 04:53:30.779529 (+ 2319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.779530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.779543 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.779574 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.780571 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.781103 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.782259 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.782570 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.782642 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.785864 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.785865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.785865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.785875 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.787609 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.788059 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.788061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.788061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.788125 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.788338 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.788338 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.788339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.788475 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.788584 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.788795 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.788881 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:53:30.792341 4787 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } attempt: 3
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:53:30.796129 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.787833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57962)
0810 04:53:30.788132 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.788143 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.788187 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.788646 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.788647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.788820 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.788870 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.788872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.789578 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.789580 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.790391 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.790395 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.790746 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.790747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.790809 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.791182 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.791187 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.792848 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.794902 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.794903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.794903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.795105 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.795331 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.795332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.795332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.795400 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.795668 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.795670 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.795718 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.795804 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.796006 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277}
I20260810 04:53:30.796413 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.788513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57962 (local address 127.15.239.252:42781)
0810 04:53:30.788549 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.788551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.788559 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:53:30.788579 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.788579 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.788589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.788641 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.788953 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.789495 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.790484 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.790667 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.790723 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.793071 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.793072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.793073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.793078 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.794812 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.795188 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.795189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.795189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.795248 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.795472 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.795473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.795473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.795593 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.795665 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.795884 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.796069 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 10 04:53:30 dist-test-slave-kvfs krb5kdc[4672](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337610, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:53:30.798707 4892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: Bootstrap starting.
I20260810 04:53:30.799602 4892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:30.799878 4892 log.cc:824] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:30.800987 4892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: No bootstrap required, opened a new log
I20260810 04:53:30.801215 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.792644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:42781 (local address 127.0.0.1:57966)
0810 04:53:30.792948 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:30.792969 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:30.793011 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:30.793182 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:30.793185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:30.793377 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:30.793438 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.793439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.794447 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.794449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.795273 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:30.795276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.795898 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.795899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:30.795961 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.796462 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:30.796467 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:30.798062 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:30.800005 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.800007 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.800007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.800264 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.800501 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:30.800502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:30.800503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:30.800582 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:30.800892 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:30.800893 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:30.800945 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 04:53:30.800993 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 04:53:30.801103 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281}
I20260810 04:53:30.801687 5047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:30.792713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57966 (local address 127.15.239.252:42781)
0810 04:53:30.792963 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:30.792965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:30.793000 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:53:30.793052 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:30.793052 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:30.793063 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:30.793525 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:30.793572 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.794347 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.795376 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:30.795710 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:30.796144 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:30.798163 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:30.798164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:30.798165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:30.798172 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:30.799901 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.800352 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.800352 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.800353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.800413 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:30.800656 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:30.800657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:30.800658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:30.800801 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:30.801415 (+ 614us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:30.801459 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 04:53:30.801555 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":159,"threads_started":1}
I20260810 04:53:30.803375 4892 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.803557 4892 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:30.803555 4787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: Bootstrap starting.
I20260810 04:53:30.803601 4892 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab20d9aed714c97868b9646ffa9d446, State: Initialized, Role: FOLLOWER
I20260810 04:53:30.803750 4892 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.804129 5050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.804211 4892 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:30.804493 4787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:30.804287 5050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:53:30.804891 4787 log.cc:824] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:30.806254 4787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: No bootstrap required, opened a new log
W20260810 04:53:30.806635 5070 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 04:53:30.808616 4787 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.808776 4787 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:30.808826 4787 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfb63c190134c97a4071329a1b9a65f, State: Initialized, Role: FOLLOWER
I20260810 04:53:30.808980 4787 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.806697 4800 master_runner.cc:186] Error getting master registration for 127.15.239.254:46027: OK, instance_id { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" instance_seqno: 1786337610342263 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:53:30.809333 4787 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:30.809345 4800 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 04:53:30.806718 5070 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:53:30.809837 5074 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.809993 5074 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:53:30.810957 5097 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 04:53:30.815024 4692 master_runner.cc:263] No leader master found from master ecfb63c190134c97a4071329a1b9a65f
I20260810 04:53:30.815092 4692 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 04:53:30.839685 4722 tablet.cc:2369] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:53:30.880491 5015 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:30.880681 5015 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.881017 5015 leader_election.cc:288] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecfb63c190134c97a4071329a1b9a65f (127.15.239.254:46027), 4ab20d9aed714c97868b9646ffa9d446 (127.15.239.253:45997)
I20260810 04:53:30.881479 4748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "58180fd38926457b88169296a88252cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfb63c190134c97a4071329a1b9a65f" is_pre_election: true
I20260810 04:53:30.881716 4748 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58180fd38926457b88169296a88252cf in term 0.
I20260810 04:53:30.881958 4860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "58180fd38926457b88169296a88252cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab20d9aed714c97868b9646ffa9d446" is_pre_election: true
I20260810 04:53:30.882133 4860 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58180fd38926457b88169296a88252cf in term 0.
I20260810 04:53:30.882354 4929 leader_election.cc:302] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58180fd38926457b88169296a88252cf, ecfb63c190134c97a4071329a1b9a65f; no voters:
I20260810 04:53:30.882535 5015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:53:30.882591 5015 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:53:30.882616 5015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:30.883875 5015 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.884145 5015 leader_election.cc:288] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [CANDIDATE]: Term 1 election: Requested vote from peers ecfb63c190134c97a4071329a1b9a65f (127.15.239.254:46027), 4ab20d9aed714c97868b9646ffa9d446 (127.15.239.253:45997)
I20260810 04:53:30.884253 4748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "58180fd38926457b88169296a88252cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfb63c190134c97a4071329a1b9a65f"
I20260810 04:53:30.884363 4748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:30.884374 4860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "58180fd38926457b88169296a88252cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab20d9aed714c97868b9646ffa9d446"
I20260810 04:53:30.884457 4860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:30.885489 4748 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58180fd38926457b88169296a88252cf in term 1.
I20260810 04:53:30.885710 4860 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58180fd38926457b88169296a88252cf in term 1.
I20260810 04:53:30.885707 4929 leader_election.cc:302] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58180fd38926457b88169296a88252cf, ecfb63c190134c97a4071329a1b9a65f; no voters:
I20260810 04:53:30.885877 5015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:30.886088 5015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [term 1 LEADER]: Becoming Leader. State: Replica: 58180fd38926457b88169296a88252cf, State: Running, Role: LEADER
I20260810 04:53:30.886193 5015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } }
I20260810 04:53:30.886710 5098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58180fd38926457b88169296a88252cf. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.886806 5098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:30.886998 5100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:30.887236 5100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:30.889127 4860 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [term 1 FOLLOWER]: Refusing update from remote peer 58180fd38926457b88169296a88252cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:30.889204 4748 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [term 1 FOLLOWER]: Refusing update from remote peer 58180fd38926457b88169296a88252cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:30.889525 5098 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:30.889622 5015 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:30.890925 5074 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58180fd38926457b88169296a88252cf. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.891023 5074 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:53:30.891548 5050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58180fd38926457b88169296a88252cf. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.891649 5050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:53:30.892338 5098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.892422 5098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:30.892669 5074 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.892784 5074 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:53:30.893119 5102 mvcc.cc:205] Tried to move back new op lower bound from 7316838854199472128 to 7316838854190641152. Current Snapshot: MvccSnapshot[applied={T|T < 7316838854199472128}]
I20260810 04:53:30.893550 5104 mvcc.cc:205] Tried to move back new op lower bound from 7316838854199472128 to 7316838854190641152. Current Snapshot: MvccSnapshot[applied={T|T < 7316838854199472128}]
I20260810 04:53:30.894781 5015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.894879 5015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:30.895231 5050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "58180fd38926457b88169296a88252cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfb63c190134c97a4071329a1b9a65f" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46027 } } peers { permanent_uuid: "4ab20d9aed714c97868b9646ffa9d446" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45997 } } peers { permanent_uuid: "58180fd38926457b88169296a88252cf" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 42781 } } }
I20260810 04:53:30.895334 5050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:53:30.896004 5109 mvcc.cc:205] Tried to move back new op lower bound from 7316838854199472128 to 7316838854190641152. Current Snapshot: MvccSnapshot[applied={T|T < 7316838854199472128 or (T in {7316838854199472128})}]
I20260810 04:53:30.896602 5100 catalog_manager.cc:1347] Generated new cluster ID: 1731d24cac9b43f3ac8716451377ac7b
I20260810 04:53:30.896667 5100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:53:30.921108 5100 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:53:30.922060 5100 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:30.933292 5100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf: Generated new TSK 0
I20260810 04:53:30.933619 5100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:53:31.810264 5070 catalog_manager.cc:1259] Loaded cluster ID: 1731d24cac9b43f3ac8716451377ac7b
I20260810 04:53:31.810392 5070 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: loading cluster ID for follower catalog manager: success
I20260810 04:53:31.811537 5070 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: acquiring CA information for follower catalog manager: success
I20260810 04:53:31.811911 5070 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4ab20d9aed714c97868b9646ffa9d446: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:53:31.811954 5097 catalog_manager.cc:1259] Loaded cluster ID: 1731d24cac9b43f3ac8716451377ac7b
I20260810 04:53:31.812055 5097 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: loading cluster ID for follower catalog manager: success
I20260810 04:53:31.813215 5097 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: acquiring CA information for follower catalog manager: success
I20260810 04:53:31.813575 5097 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecfb63c190134c97a4071329a1b9a65f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:53:31.996908 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 4692
W20260810 04:53:32.017015 4929 connection.cc:535] client connection to 127.15.239.254:46027 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:53:32.017239 4929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:53:32.017465 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 4800
I20260810 04:53:32.025715 5123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:32.023214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46027 (local address 127.0.0.1:59656)
0810 04:53:32.025518 (+ 2304us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:32.025622 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2273,"thread_start_us":1834,"threads_started":1}
W20260810 04:53:32.025949 4929 consensus_peers.cc:487] T 00000000000000000000000000000000 P 58180fd38926457b88169296a88252cf -> Peer ecfb63c190134c97a4071329a1b9a65f (127.15.239.254:46027): Couldn't send request to peer ecfb63c190134c97a4071329a1b9a65f. Status: Network error: Client connection negotiation failed: client connection to 127.15.239.254:46027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 04:53:32.033962 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 4905
2026-08-10T04:53:32Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3295 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:53:32 dist-test-slave-kvfs krb5kdc[5127](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:53:32 dist-test-slave-kvfs krb5kdc[5127](info): set up 2 sockets
Aug 10 04:53:32 dist-test-slave-kvfs krb5kdc[5127](info): commencing operation
krb5kdc: starting...
W20260810 04:53:33.330442 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:53:33 dist-test-slave-kvfs krb5kdc[5127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:53:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:53:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:53:33.475777 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39181
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:39181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:33.573917 5149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:33.574249 5149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:33.574290 5149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:33.575537 5149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:33.575615 5149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:33.575640 5149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:33.575665 5149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:33.575695 5149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:33.577329 5149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:39181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:33.577668 5149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:33.577950 5149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:53:33.583863 5149 server_base.cc:1034] running on GCE node
W20260810 04:53:33.583896 5157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:33.583853 5160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:33.583871 5158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:33.584477 5149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:33.584800 5149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:33.585986 5149 hybrid_clock.cc:648] HybridClock initialized: now 1786337613585967 us; error 56 us; skew 500 ppm
Aug 10 04:53:33 dist-test-slave-kvfs krb5kdc[5127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337613, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:33.589337 5149 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:33.589838 5149 webserver.cc:460] Webserver started at http://127.15.239.254:38405/ using document root <none> and password file <none>
I20260810 04:53:33.590096 5149 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:33.590147 5149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:33.590265 5149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:33.591593 5149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "70e4c36042e74a49b1110da477f93878"
format_stamp: "Formatted at 2026-08-10 04:53:33 on dist-test-slave-kvfs"
server_key: "819fa2c3e9ba03bde1d76b967dce27b9"
server_key_iv: "8014ac6cde8db406318816fee4a09f1a"
server_key_version: "encryptionkey@0"
I20260810 04:53:33.591986 5149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "70e4c36042e74a49b1110da477f93878"
format_stamp: "Formatted at 2026-08-10 04:53:33 on dist-test-slave-kvfs"
server_key: "819fa2c3e9ba03bde1d76b967dce27b9"
server_key_iv: "8014ac6cde8db406318816fee4a09f1a"
server_key_version: "encryptionkey@0"
I20260810 04:53:33.593734 5149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:53:33.594588 5172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:33.594803 5149 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:33.594929 5149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "70e4c36042e74a49b1110da477f93878"
format_stamp: "Formatted at 2026-08-10 04:53:33 on dist-test-slave-kvfs"
server_key: "819fa2c3e9ba03bde1d76b967dce27b9"
server_key_iv: "8014ac6cde8db406318816fee4a09f1a"
server_key_version: "encryptionkey@0"
I20260810 04:53:33.595033 5149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:33.605520 5149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:33.607899 5149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:33.608160 5149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:33.613557 5149 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:39181
I20260810 04:53:33.613593 5257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:39181 every 8 connection(s)
I20260810 04:53:33.614090 5149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:33.615253 5258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:33.618181 5258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878: Bootstrap starting.
I20260810 04:53:33.618935 5258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:33.619304 5258 log.cc:824] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:33.620225 5258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878: No bootstrap required, opened a new log
I20260810 04:53:33.622102 5258 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70e4c36042e74a49b1110da477f93878" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39181 } }
I20260810 04:53:33.622282 5258 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:33.622308 5258 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70e4c36042e74a49b1110da477f93878, State: Initialized, Role: FOLLOWER
I20260810 04:53:33.622512 5258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70e4c36042e74a49b1110da477f93878" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39181 } }
I20260810 04:53:33.622592 5258 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:33.622617 5258 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:33.622650 5258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:33.623351 5258 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70e4c36042e74a49b1110da477f93878" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39181 } }
I20260810 04:53:33.623508 5258 leader_election.cc:302] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70e4c36042e74a49b1110da477f93878; no voters:
I20260810 04:53:33.623538 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 5149
I20260810 04:53:33.623649 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:53:33.623735 5258 leader_election.cc:288] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:53:33.623791 5262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:33.623922 16319 external_mini_cluster.cc:1428] Setting key abb588e9c3902997cbfd41bc57e40d93
I20260810 04:53:33.624081 5262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [term 1 LEADER]: Becoming Leader. State: Replica: 70e4c36042e74a49b1110da477f93878, State: Running, Role: LEADER
I20260810 04:53:33.624135 5258 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:33.624225 5262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70e4c36042e74a49b1110da477f93878" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39181 } }
I20260810 04:53:33.624816 5268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70e4c36042e74a49b1110da477f93878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70e4c36042e74a49b1110da477f93878" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39181 } } }
I20260810 04:53:33.624910 5268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:33.624995 5266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70e4c36042e74a49b1110da477f93878. Latest consensus state: current_term: 1 leader_uuid: "70e4c36042e74a49b1110da477f93878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70e4c36042e74a49b1110da477f93878" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39181 } } }
I20260810 04:53:33.625077 5266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:33.625128 5275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:33.625844 5275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:33.629645 5275 catalog_manager.cc:1347] Generated new cluster ID: 02cf3fb1530d49a0bd3b6013a8806c22
I20260810 04:53:33.629714 5275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:53:33 dist-test-slave-kvfs krb5kdc[5127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:33.637773 5273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:33.624569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.15.239.254:39181)
0810 04:53:33.624928 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:33.624941 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:33.624985 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:53:33.625159 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:33.625170 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:33.625256 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:33.626378 (+ 1122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:33.626556 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:33.627990 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:33.629151 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:33.629683 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:33.630230 (+ 547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:33.633007 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:33.633013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:33.633013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:33.633037 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:33.635746 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:33.636291 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:33.636295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:33.636296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:33.636431 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:33.636688 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:33.636689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:33.636689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:33.637022 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:33.637257 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:33.637340 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 04:53:33.637539 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":110,"threads_started":1}
I20260810 04:53:33.638991 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:53:33.641249 5275 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:53:33.641858 5275 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:33.650604 5275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70e4c36042e74a49b1110da477f93878: Generated new TSK 0
I20260810 04:53:33.650859 5275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:53:33.693933 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 5149
2026-08-10T04:53:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1662 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:53:33 dist-test-slave-kvfs krb5kdc[5302](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:53:33 dist-test-slave-kvfs krb5kdc[5302](info): set up 2 sockets
Aug 10 04:53:33 dist-test-slave-kvfs krb5kdc[5302](info): commencing operation
krb5kdc: starting...
W20260810 04:53:34.980720 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:53:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:53:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:53:35.131433 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37779
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:37779
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:35.230787 5318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:35.231122 5318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:35.231165 5318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:35.232543 5318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:35.232621 5318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:35.232647 5318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:35.232671 5318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:35.232700 5318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:35.234411 5318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:37779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:35.234746 5318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:35.235051 5318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:35.241061 5330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:35.241015 5327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:35.241015 5328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:35.241405 5318 server_base.cc:1034] running on GCE node
I20260810 04:53:35.241753 5318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:35.242154 5318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:35.243330 5318 hybrid_clock.cc:648] HybridClock initialized: now 1786337615243308 us; error 56 us; skew 500 ppm
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:35.251319 5318 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:35.251946 5318 webserver.cc:460] Webserver started at http://127.15.239.254:38851/ using document root <none> and password file <none>
I20260810 04:53:35.252354 5318 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:35.252434 5318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:35.252638 5318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:35.254015 5318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "6cb089e540814a7baea41c06f04e50c6"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "1e95b7936683d98d5b465c210fee42a1"
server_key_iv: "30811a418ee63bcea2ad824b4d5a80e1"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.254472 5318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "6cb089e540814a7baea41c06f04e50c6"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "1e95b7936683d98d5b465c210fee42a1"
server_key_iv: "30811a418ee63bcea2ad824b4d5a80e1"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.256291 5318 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260810 04:53:35.257315 5341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.257532 5318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:35.257668 5318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "6cb089e540814a7baea41c06f04e50c6"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "1e95b7936683d98d5b465c210fee42a1"
server_key_iv: "30811a418ee63bcea2ad824b4d5a80e1"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.257798 5318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:35.267895 5318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:35.270418 5318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:35.270632 5318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:35.276293 5318 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:37779
I20260810 04:53:35.276327 5412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:37779 every 8 connection(s)
I20260810 04:53:35.276829 5318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:35.278142 5413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:35.278918 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 5318
I20260810 04:53:35.279033 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:53:35.279271 16319 external_mini_cluster.cc:1428] Setting key 34bf9db94ca9f3a7716c760b25c4688b
I20260810 04:53:35.282104 5413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap starting.
I20260810 04:53:35.282903 5413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:35.283275 5413 log.cc:824] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:35.284147 5413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: No bootstrap required, opened a new log
I20260810 04:53:35.286403 5413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:35.286579 5413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:35.286604 5413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cb089e540814a7baea41c06f04e50c6, State: Initialized, Role: FOLLOWER
I20260810 04:53:35.286787 5413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:35.286882 5413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:35.286909 5413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:35.286994 5413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:35.287689 5413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:35.287832 5413 leader_election.cc:302] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cb089e540814a7baea41c06f04e50c6; no voters:
I20260810 04:53:35.288110 5413 leader_election.cc:288] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:53:35.288146 5425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:35.288290 5425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6cb089e540814a7baea41c06f04e50c6, State: Running, Role: LEADER
I20260810 04:53:35.288478 5413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:35.288447 5425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:35.288955 5427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cb089e540814a7baea41c06f04e50c6. Latest consensus state: current_term: 1 leader_uuid: "6cb089e540814a7baea41c06f04e50c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } } }
I20260810 04:53:35.289173 5427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:35.289570 5430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:35.289199 5426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cb089e540814a7baea41c06f04e50c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } } }
I20260810 04:53:35.289834 5426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:35.290274 5430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:35.292574 5430 catalog_manager.cc:1347] Generated new cluster ID: 516f816d2f554b4fa9ea8d1581552ed5
I20260810 04:53:35.292655 5430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:53:35.294132 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.280107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51468 (local address 127.15.239.254:37779)
0810 04:53:35.280337 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.280348 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.280382 (+ 34us) server_negotiation.cc:407] Connection header received
0810 04:53:35.280964 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.280995 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.281059 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.281209 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:35.282127 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.283716 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.284928 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.285469 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.285624 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.289315 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:35.289322 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:35.289322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:35.289340 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:35.291973 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.292554 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.292559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.292560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.292769 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.293054 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.293055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.293056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.293361 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:35.293557 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.293688 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.293859 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":108,"threads_started":1}
I20260810 04:53:35.323693 5430 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:53:35.324710 5430 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:35.327279 5430 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Generated new TSK 0
I20260810 04:53:35.327579 5430 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:53:35.367411 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37779
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:35.471438 5451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:35.471719 5451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:35.471746 5451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:35.473178 5451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:35.473227 5451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:35.473255 5451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:53:35.474799 5451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:35.475103 5451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:35.475389 5451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:35.483357 5458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:35.483364 5460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:35.483400 5457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:35.485694 5451 server_base.cc:1034] running on GCE node
I20260810 04:53:35.485984 5451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:35.486318 5451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:35.487514 5451 hybrid_clock.cc:648] HybridClock initialized: now 1786337615487454 us; error 41 us; skew 500 ppm
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:35.490809 5451 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:53:35.491335 5451 webserver.cc:460] Webserver started at http://127.15.239.193:38443/ using document root <none> and password file <none>
I20260810 04:53:35.491626 5451 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:35.491704 5451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:35.491871 5451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:35.493193 5451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "0c31cfd714374e27afca6f7b8ad5fdf3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "b98aa24325925144a8cb2a23c443a7ca"
server_key_iv: "df4509a8db3979b9aa720ebef54b89b2"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.493623 5451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "0c31cfd714374e27afca6f7b8ad5fdf3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "b98aa24325925144a8cb2a23c443a7ca"
server_key_iv: "df4509a8db3979b9aa720ebef54b89b2"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.495217 5451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:53:35.496148 5470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.496323 5451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:35.496459 5451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "0c31cfd714374e27afca6f7b8ad5fdf3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "b98aa24325925144a8cb2a23c443a7ca"
server_key_iv: "df4509a8db3979b9aa720ebef54b89b2"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.496549 5451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:35.520633 5451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:35.523100 5451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:35.523303 5451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:35.523607 5451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:35.524012 5451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:35.524096 5451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.524142 5451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:35.524174 5451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.531806 5451 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:39881
I20260810 04:53:35.531867 5639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:39881 every 8 connection(s)
I20260810 04:53:35.532274 5451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:53:35.536125 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 5451
I20260810 04:53:35.536262 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:53:35.536501 16319 external_mini_cluster.cc:1428] Setting key 93a088690fb87b6e82e10009ee698de0
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:35.544798 5643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.533170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:38609)
0810 04:53:35.533367 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:35.533418 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:35.534037 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:35.534328 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:35.534332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:35.535011 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:35.535261 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.535266 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.536164 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.536166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.537289 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.537293 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.537746 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.537748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.537930 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.538616 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:35.538629 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:35.540788 (+ 2159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:35.542837 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:35.542845 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:35.542847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:35.543160 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:35.543407 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:35.543408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:35.543409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:35.543570 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:35.543948 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:35.543955 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:35.544160 (+ 205us) client_negotiation.cc:769] Sending connection context
0810 04:53:35.544275 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 04:53:35.544485 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":105,"threads_started":1}
I20260810 04:53:35.544936 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.533191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:38609 (local address 127.15.239.254:37779)
0810 04:53:35.533268 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.533270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.533530 (+ 260us) server_negotiation.cc:407] Connection header received
0810 04:53:35.534167 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.534169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.534184 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.534258 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:35.535384 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.535991 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.537403 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.537641 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.537703 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.540913 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:35.540916 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:35.540916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:35.540925 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:35.542731 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.543250 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.543252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.543252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.543330 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.543656 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.543657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.543658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.543857 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:35.543955 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.544723 (+ 768us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.544828 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:53:35.545437 5640 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37779
I20260810 04:53:35.545586 5640 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:35.545825 5640 heartbeater.cc:511] Master 127.15.239.254:37779 requested a full tablet report, sending...
I20260810 04:53:35.546509 5362 ts_manager.cc:194] Registered new tserver with Master: 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193:39881)
I20260810 04:53:35.547185 5362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:38609
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:53:35.571579 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37779
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:35.669193 5646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:35.669443 5646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:35.669467 5646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:35.670598 5646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:35.670634 5646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:35.670660 5646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:53:35.672109 5646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:35.672324 5646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:35.672539 5646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:35.678318 5653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:35.678529 5646 server_base.cc:1034] running on GCE node
W20260810 04:53:35.678398 5655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:35.678416 5652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:35.678905 5646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:35.679136 5646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:35.680274 5646 hybrid_clock.cc:648] HybridClock initialized: now 1786337615680254 us; error 38 us; skew 500 ppm
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:35.683092 5646 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:53:35.683552 5646 webserver.cc:460] Webserver started at http://127.15.239.194:35301/ using document root <none> and password file <none>
I20260810 04:53:35.683763 5646 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:35.683804 5646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:35.683904 5646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:35.685125 5646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "d60a66ff201c92f141a6c3c70739363d"
server_key_iv: "793c86279c3a49bc55a9485e999935f4"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.685479 5646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "d60a66ff201c92f141a6c3c70739363d"
server_key_iv: "793c86279c3a49bc55a9485e999935f4"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.686892 5646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:53:35.687729 5665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.687960 5646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:35.688146 5646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "d60a66ff201c92f141a6c3c70739363d"
server_key_iv: "793c86279c3a49bc55a9485e999935f4"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.688282 5646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:35.697861 5646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:35.700598 5646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:35.700744 5646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:35.700976 5646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:35.701298 5646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:35.701335 5646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.701361 5646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:35.701376 5646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.708851 5646 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:36373
I20260810 04:53:35.708941 5825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:36373 every 8 connection(s)
I20260810 04:53:35.709370 5646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:35.719485 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 5646
I20260810 04:53:35.719604 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:53:35.719841 16319 external_mini_cluster.cc:1428] Setting key fc204cd50a36b8db6b8ce9ed2d131c17
I20260810 04:53:35.720743 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.710399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:34857 (local address 127.15.239.254:37779)
0810 04:53:35.710545 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.710548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.710738 (+ 190us) server_negotiation.cc:407] Connection header received
0810 04:53:35.711401 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.711403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.711418 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.711482 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:35.712690 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.713259 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.714392 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.714612 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.714707 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.717344 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:35.717346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:35.717346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:35.717356 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:35.718799 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.719270 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.719272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.719273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.719359 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.719821 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.719823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.719823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.720076 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:35.720161 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.720494 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.720597 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260810 04:53:35.720965 5828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.710315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:34857)
0810 04:53:35.710578 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:35.710634 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:35.711271 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:35.711565 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:35.711570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:35.712324 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:35.712564 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.712569 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.713365 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.713366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.714274 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.714276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.714734 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.714735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.714885 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.715512 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:35.715522 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:35.717239 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:35.718882 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:35.718910 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:35.718912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:35.719168 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:35.719461 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:35.719462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:35.719462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:35.719722 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:35.720167 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:35.720175 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:35.720332 (+ 157us) client_negotiation.cc:769] Sending connection context
0810 04:53:35.720455 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:53:35.720659 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":109,"threads_started":1}
I20260810 04:53:35.721535 5826 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37779
I20260810 04:53:35.721665 5826 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:35.721920 5826 heartbeater.cc:511] Master 127.15.239.254:37779 requested a full tablet report, sending...
I20260810 04:53:35.722379 5362 ts_manager.cc:194] Registered new tserver with Master: c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373)
I20260810 04:53:35.722805 5362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:34857
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:53:35.752009 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37779
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:35.850927 5832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:35.851181 5832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:35.851205 5832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:35.852526 5832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:35.852571 5832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:35.852599 5832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:53:35.854194 5832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:35.854494 5832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:35.854775 5832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:35.860792 5839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:35.860816 5838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:35.861164 5832 server_base.cc:1034] running on GCE node
W20260810 04:53:35.860801 5841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:35.861485 5832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:35.861724 5832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:35.862923 5832 hybrid_clock.cc:648] HybridClock initialized: now 1786337615862919 us; error 51 us; skew 500 ppm
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:35.865940 5832 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:53:35.866398 5832 webserver.cc:460] Webserver started at http://127.15.239.195:42089/ using document root <none> and password file <none>
I20260810 04:53:35.866693 5832 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:35.866765 5832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:35.866936 5832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:35.868227 5832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "20fd251a81274fc68620e0aef9463287"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "74416b336946df7a1415cfd9463f48d3"
server_key_iv: "0a1ad79d7d2ed08e45acefdcd114b0d4"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.868628 5832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "20fd251a81274fc68620e0aef9463287"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "74416b336946df7a1415cfd9463f48d3"
server_key_iv: "0a1ad79d7d2ed08e45acefdcd114b0d4"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.870085 5832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 04:53:35.870939 5851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.871206 5832 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:35.871335 5832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "20fd251a81274fc68620e0aef9463287"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "74416b336946df7a1415cfd9463f48d3"
server_key_iv: "0a1ad79d7d2ed08e45acefdcd114b0d4"
server_key_version: "encryptionkey@0"
I20260810 04:53:35.871420 5832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:35.887128 5832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:35.889586 5832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:35.889828 5832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:35.890148 5832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:35.890527 5832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:35.890585 5832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.890671 5832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:35.890702 5832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:35.898102 5832 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:42381
I20260810 04:53:35.898192 6028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:42381 every 8 connection(s)
I20260810 04:53:35.898588 5832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:53:35.898830 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 5832
I20260810 04:53:35.898924 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:53:35.899192 16319 external_mini_cluster.cc:1428] Setting key 5e6b4119436cf5503e3fe5f36c1562f9
Aug 10 04:53:35 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337615, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:35.909653 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.899676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:47155 (local address 127.15.239.254:37779)
0810 04:53:35.899762 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.899765 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.900016 (+ 251us) server_negotiation.cc:407] Connection header received
0810 04:53:35.900876 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.900877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.900895 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.900938 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:35.902018 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.902570 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.903638 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.903835 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.903911 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.906636 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:35.906637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:35.906638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:35.906646 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:35.908274 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.908668 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.908670 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.908670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.908733 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.908987 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.908988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.908988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.909135 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:35.909193 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.909486 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.909577 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 04:53:35.909808 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.899628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:47155)
0810 04:53:35.899834 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:35.899909 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:35.900763 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:35.901012 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:35.901016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:35.901691 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:35.901936 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.901941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.902655 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.902656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.903560 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.903563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.903915 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.903915 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.904092 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.904745 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:35.904755 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:35.906541 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:35.908350 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:35.908357 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:35.908359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:35.908595 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:35.908821 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:35.908821 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:35.908822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:35.908927 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:35.909193 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:35.909198 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:35.909332 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 04:53:35.909422 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:53:35.909560 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":101,"threads_started":1}
I20260810 04:53:35.910390 6030 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37779
I20260810 04:53:35.910502 6030 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:35.910738 6030 heartbeater.cc:511] Master 127.15.239.254:37779 requested a full tablet report, sending...
I20260810 04:53:35.911206 5362 ts_manager.cc:194] Registered new tserver with Master: 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
I20260810 04:53:35.911679 5362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:47155
I20260810 04:53:35.922958 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:53:35.932291 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.924942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51482 (local address 127.15.239.254:37779)
0810 04:53:35.925023 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.925026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.925163 (+ 137us) server_negotiation.cc:407] Connection header received
0810 04:53:35.925216 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.925217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.925228 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.925283 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:35.926017 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.926576 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.927364 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.927579 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.927636 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.929147 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:35.929149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:35.929149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:35.929157 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:35.930757 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.931151 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.931153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.931153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.931213 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:35.931413 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:35.931414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:35.931415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:35.931610 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:35.931698 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.931920 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.932124 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:53:35.934607 5362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:53:35.936951 5362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:53:35.944877 6053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.940679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39881 (local address 127.0.0.1:34644)
0810 04:53:35.941109 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:35.941118 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:35.941213 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:35.941423 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:35.941424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:35.941427 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:35.941505 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.941507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.942560 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.942561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.943650 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.943653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.944493 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.944494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.944582 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.944597 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 04:53:35.944677 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:53:35.944749 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260810 04:53:35.944927 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.940348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.15.239.194:36373)
0810 04:53:35.940749 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.940756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.940771 (+ 15us) server_negotiation.cc:407] Connection header received
0810 04:53:35.940832 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.940834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.940854 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.941221 (+ 367us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:35.941306 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.942058 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.943756 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.944562 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.944640 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.944692 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.944780 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.944829 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":151,"threads_started":1}
I20260810 04:53:35.945667 6055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.940841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34644 (local address 127.15.239.193:39881)
0810 04:53:35.941063 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.941069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.941201 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:53:35.941299 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.941302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.941319 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.941429 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:35.941569 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.942431 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.943764 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.944390 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.944490 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.944564 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.945541 (+ 977us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.945586 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":117,"threads_started":1}
I20260810 04:53:35.946128 6052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.940414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:42381 (local address 127.0.0.1:41000)
0810 04:53:35.940585 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:35.940595 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:35.940645 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:35.942401 (+ 1756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:35.942402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:35.942404 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:35.942478 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.942480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.943581 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.943582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.944725 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.944728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.945705 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.945706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.945879 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.945890 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 04:53:35.945974 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 04:53:35.946029 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":125,"threads_started":1}
I20260810 04:53:35.946458 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.940857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41000 (local address 127.15.239.195:42381)
0810 04:53:35.942230 (+ 1373us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:35.942234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:35.942244 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:53:35.942281 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:35.942283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:35.942297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:35.942400 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:35.942544 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.943461 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.944825 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.945604 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.945697 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.945757 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:35.946257 (+ 500us) server_negotiation.cc:299] Negotiation successful
0810 04:53:35.946326 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1327,"thread_start_us":127,"threads_started":1}
I20260810 04:53:35.944877 6050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:35.940141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36373 (local address 127.0.0.1:49874)
0810 04:53:35.940275 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:35.940328 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:35.940411 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:35.941016 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:35.941022 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:35.941025 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:35.941141 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.941143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.942166 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.942167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.943651 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:35.943653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:35.944638 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:35.944639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:35.944702 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:35.944705 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:53:35.944752 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 04:53:35.944792 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":27,"thread_start_us":78,"threads_started":1}
I20260810 04:53:35.947355 5540 tablet_service.cc:1467] Processing CreateTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b (DEFAULT_TABLE table=test-table [id=ec543acc922444c890e78a398bf2d6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:35.947369 5926 tablet_service.cc:1467] Processing CreateTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b (DEFAULT_TABLE table=test-table [id=ec543acc922444c890e78a398bf2d6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:35.947893 5540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bb404ffef2e45dabab7f5fde4f2570b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:35.947919 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bb404ffef2e45dabab7f5fde4f2570b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:35.952255 6058 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Bootstrap starting.
I20260810 04:53:35.952492 5736 tablet_service.cc:1467] Processing CreateTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b (DEFAULT_TABLE table=test-table [id=ec543acc922444c890e78a398bf2d6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:35.952957 5736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bb404ffef2e45dabab7f5fde4f2570b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:35.953222 6058 tablet_bootstrap.cc:654] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:35.953940 6058 log.cc:824] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:35.954380 6059 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap starting.
I20260810 04:53:35.954881 6058 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: No bootstrap required, opened a new log
I20260810 04:53:35.954939 6058 ts_tablet_manager.cc:1397] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:53:35.955133 6059 tablet_bootstrap.cc:654] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:35.955794 6059 log.cc:824] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:35.956740 6059 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: No bootstrap required, opened a new log
I20260810 04:53:35.956831 6059 ts_tablet_manager.cc:1397] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:53:35.956879 6058 raft_consensus.cc:348] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:35.957085 6058 raft_consensus.cc:374] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:35.957135 6058 raft_consensus.cc:729] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fd251a81274fc68620e0aef9463287, State: Initialized, Role: FOLLOWER
I20260810 04:53:35.957301 6058 consensus_queue.cc:260] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:35.957533 6063 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Bootstrap starting.
I20260810 04:53:35.957656 6030 heartbeater.cc:503] Master 127.15.239.254:37779 was elected leader, sending a full tablet report...
I20260810 04:53:35.957647 6058 ts_tablet_manager.cc:1428] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:53:35.958304 6063 tablet_bootstrap.cc:654] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:35.958954 6063 log.cc:824] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:35.959066 6059 raft_consensus.cc:348] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:35.959268 6059 raft_consensus.cc:374] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:35.959296 6059 raft_consensus.cc:729] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c31cfd714374e27afca6f7b8ad5fdf3, State: Initialized, Role: FOLLOWER
I20260810 04:53:35.959466 6059 consensus_queue.cc:260] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:35.959820 6059 ts_tablet_manager.cc:1428] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:53:35.959846 6063 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: No bootstrap required, opened a new log
I20260810 04:53:35.959864 5640 heartbeater.cc:503] Master 127.15.239.254:37779 was elected leader, sending a full tablet report...
I20260810 04:53:35.959941 6063 ts_tablet_manager.cc:1397] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:53:35.961827 6063 raft_consensus.cc:348] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:35.961995 6063 raft_consensus.cc:374] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:35.962042 6063 raft_consensus.cc:729] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5faa504780b44ad89c8dc7a7dc88be3, State: Initialized, Role: FOLLOWER
I20260810 04:53:35.962177 6063 consensus_queue.cc:260] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:35.962505 5826 heartbeater.cc:503] Master 127.15.239.254:37779 was elected leader, sending a full tablet report...
I20260810 04:53:35.962489 6063 ts_tablet_manager.cc:1428] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:53:36.007215 6070 raft_consensus.cc:482] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:36.007408 6070 raft_consensus.cc:504] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.008085 6070 leader_election.cc:288] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
I20260810 04:53:36.011598 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.008568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:45947 (local address 127.15.239.195:42381)
0810 04:53:36.008652 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.008672 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.008685 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:53:36.008718 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.008719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.008731 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.008802 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:36.009155 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.009716 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.010770 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.011177 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.011240 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.011250 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.011452 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.011517 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:53:36.011597 5643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.008288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36373 (local address 127.15.239.193:55807)
0810 04:53:36.008379 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.008400 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.008478 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.008708 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.008709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.008712 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:36.008813 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.008816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.009692 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.009693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.010557 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.010559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.011317 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.011318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.011385 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.011388 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.011466 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.011511 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 04:53:36.011618 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.008438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:55807 (local address 127.15.239.194:36373)
0810 04:53:36.008540 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.008542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.008551 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:53:36.008592 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.008593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.008611 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.008685 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:36.009018 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.009601 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.010740 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.011206 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.011309 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.011318 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.011492 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.011545 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 04:53:36.011607 6072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.008440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:42381 (local address 127.15.239.193:45947)
0810 04:53:36.008593 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.008602 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.008648 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.008846 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.008847 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.008849 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:36.009071 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.009073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.009815 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.009817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.010582 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.010585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.011275 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.011276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.011373 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.011378 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.011423 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.011493 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260810 04:53:36.012179 5953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bb404ffef2e45dabab7f5fde4f2570b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fd251a81274fc68620e0aef9463287" is_pre_election: true
I20260810 04:53:36.012190 5759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bb404ffef2e45dabab7f5fde4f2570b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" is_pre_election: true
I20260810 04:53:36.012411 5953 raft_consensus.cc:2454] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 0.
I20260810 04:53:36.012413 5759 raft_consensus.cc:2454] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 0.
I20260810 04:53:36.012702 5474 leader_election.cc:302] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3, c5faa504780b44ad89c8dc7a7dc88be3; no voters:
I20260810 04:53:36.012894 6070 raft_consensus.cc:2781] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:53:36.012977 6070 raft_consensus.cc:482] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:53:36.013013 6070 raft_consensus.cc:3037] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:36.013938 6070 raft_consensus.cc:504] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.014108 6070 leader_election.cc:288] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 election: Requested vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
I20260810 04:53:36.014288 5759 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bb404ffef2e45dabab7f5fde4f2570b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
I20260810 04:53:36.014333 5953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bb404ffef2e45dabab7f5fde4f2570b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fd251a81274fc68620e0aef9463287"
I20260810 04:53:36.014392 5759 raft_consensus.cc:3037] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:36.014451 5953 raft_consensus.cc:3037] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:36.015293 5953 raft_consensus.cc:2454] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 1.
I20260810 04:53:36.015359 5759 raft_consensus.cc:2454] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 1.
I20260810 04:53:36.015558 5474 leader_election.cc:302] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3, c5faa504780b44ad89c8dc7a7dc88be3; no voters:
I20260810 04:53:36.015676 6070 raft_consensus.cc:2781] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:36.015892 6070 raft_consensus.cc:686] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 LEADER]: Becoming Leader. State: Replica: 0c31cfd714374e27afca6f7b8ad5fdf3, State: Running, Role: LEADER
I20260810 04:53:36.016026 6070 consensus_queue.cc:237] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.017135 5362 catalog_manager.cc:5495] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } health_report { overall_health: HEALTHY } } }
W20260810 04:53:36.033155 5642 tablet.cc:2369] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:53:36.039331 6055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.036679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34656 (local address 127.15.239.193:39881)
0810 04:53:36.036755 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.036758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.036770 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:53:36.036814 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.036815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.036859 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.036932 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:53:36.037118 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.037637 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.038449 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.038647 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.038709 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.038912 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:53:36.039049 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:53:36.039131 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.039147 (+ 16us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.039169 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 04:53:36.041884 5759 raft_consensus.cc:1261] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Refusing update from remote peer 0c31cfd714374e27afca6f7b8ad5fdf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:36.041885 5953 raft_consensus.cc:1261] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Refusing update from remote peer 0c31cfd714374e27afca6f7b8ad5fdf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:36.042443 6074 consensus_queue.cc:1035] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:36.042655 6070 consensus_queue.cc:1035] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:36.046486 6080 mvcc.cc:205] Tried to move back new op lower bound from 7316838875303800832 to 7316838875202490368. Current Snapshot: MvccSnapshot[applied={T|T < 7316838875303800832}]
I20260810 04:53:36.046705 6082 mvcc.cc:205] Tried to move back new op lower bound from 7316838875303800832 to 7316838875202490368. Current Snapshot: MvccSnapshot[applied={T|T < 7316838875303800832 or (T in {7316838875303800832})}]
I20260810 04:53:36.048061 5362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:36.048175 5362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:36.049041 5362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Sending DeleteTablet for 3 replicas of tablet 1bb404ffef2e45dabab7f5fde4f2570b
I20260810 04:53:36.049424 5736 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:49874
I20260810 04:53:36.049467 5926 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:41000
I20260810 04:53:36.049506 5540 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:34644
I20260810 04:53:36.049728 6091 tablet_replica.cc:330] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: stopping tablet replica
I20260810 04:53:36.049757 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 5451
I20260810 04:53:36.049875 6091 raft_consensus.cc:2229] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:36.050034 6091 raft_consensus.cc:2258] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:36.056947 6095 tablet_replica.cc:330] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: stopping tablet replica
I20260810 04:53:36.057118 6095 raft_consensus.cc:2229] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:36.057255 6095 raft_consensus.cc:2258] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:36.057689 6091 ts_tablet_manager.cc:1905] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:36.059794 6091 ts_tablet_manager.cc:1918] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:36.059906 6091 log.cc:1196] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/1bb404ffef2e45dabab7f5fde4f2570b
I20260810 04:53:36.060237 6091 ts_tablet_manager.cc:1939] T 1bb404ffef2e45dabab7f5fde4f2570b P c5faa504780b44ad89c8dc7a7dc88be3: Deleting consensus metadata
I20260810 04:53:36.060808 5344 catalog_manager.cc:4841] TS c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373): tablet 1bb404ffef2e45dabab7f5fde4f2570b (table test-table [id=ec543acc922444c890e78a398bf2d6ef]) successfully deleted
I20260810 04:53:36.061091 6095 ts_tablet_manager.cc:1905] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:36.063222 6095 ts_tablet_manager.cc:1918] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:36.063323 6095 log.cc:1196] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/1bb404ffef2e45dabab7f5fde4f2570b
I20260810 04:53:36.063616 6095 ts_tablet_manager.cc:1939] T 1bb404ffef2e45dabab7f5fde4f2570b P 20fd251a81274fc68620e0aef9463287: Deleting consensus metadata
I20260810 04:53:36.064167 5344 catalog_manager.cc:4841] TS 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381): tablet 1bb404ffef2e45dabab7f5fde4f2570b (table test-table [id=ec543acc922444c890e78a398bf2d6ef]) successfully deleted
W20260810 04:53:36.068528 5344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:39881 (error 108)
I20260810 04:53:36.068902 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 5646
I20260810 04:53:36.071765 6050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.069064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39881 (local address 127.0.0.1:34660)
0810 04:53:36.071637 (+ 2573us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.071703 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:39881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2535}
W20260810 04:53:36.073549 5344 catalog_manager.cc:4584] TS 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193:39881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1bb404ffef2e45dabab7f5fde4f2570b: Network error: Client connection negotiation failed: client connection to 127.15.239.193:39881: connect: Connection refused (error 111)
I20260810 04:53:36.084682 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 5832
I20260810 04:53:36.103353 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 5318
I20260810 04:53:36.123216 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37779
--webserver_interface=127.15.239.254
--webserver_port=38851
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:37779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:36.220778 6103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:36.221055 6103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:36.221077 6103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:36.222328 6103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:36.222376 6103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:36.222390 6103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:36.222404 6103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:36.222416 6103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:36.224169 6103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:37779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=38851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:36.224475 6103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:36.224782 6103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:36.236824 6111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:36.237054 6103 server_base.cc:1034] running on GCE node
W20260810 04:53:36.236819 6113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:36.236819 6115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:36.237557 6103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:36.237946 6103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:36.239130 6103 hybrid_clock.cc:648] HybridClock initialized: now 1786337616239103 us; error 38 us; skew 500 ppm
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:36.242419 6103 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:36.243007 6103 webserver.cc:460] Webserver started at http://127.15.239.254:38851/ using document root <none> and password file <none>
I20260810 04:53:36.243290 6103 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:36.243386 6103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:36.245095 6103 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:36.245860 6129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.246047 6103 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:36.246173 6103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "6cb089e540814a7baea41c06f04e50c6"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "1e95b7936683d98d5b465c210fee42a1"
server_key_iv: "30811a418ee63bcea2ad824b4d5a80e1"
server_key_version: "encryptionkey@0"
I20260810 04:53:36.246708 6103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:36.259351 6103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:36.262581 6103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:36.262796 6103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:36.268679 6103 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:37779
I20260810 04:53:36.268712 6205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:37779 every 8 connection(s)
I20260810 04:53:36.269241 6103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:36.270849 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 6103
I20260810 04:53:36.271221 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:39881
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:37779
--webserver_port=38443
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:53:36.271944 6206 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:53:36.273278 6206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap starting.
I20260810 04:53:36.285027 6206 log.cc:824] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:36.287847 6206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:53:36.288286 6206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap complete.
I20260810 04:53:36.291090 6206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:36.291359 6206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cb089e540814a7baea41c06f04e50c6, State: Initialized, Role: FOLLOWER
I20260810 04:53:36.291576 6206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:36.291653 6206 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:36.291710 6206 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:36.291766 6206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:53:36.293076 6206 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:36.293213 6206 leader_election.cc:302] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cb089e540814a7baea41c06f04e50c6; no voters:
I20260810 04:53:36.293447 6206 leader_election.cc:288] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:53:36.293548 6211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:53:36.293725 6211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 LEADER]: Becoming Leader. State: Replica: 6cb089e540814a7baea41c06f04e50c6, State: Running, Role: LEADER
I20260810 04:53:36.293792 6206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:36.293954 6211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:36.294438 6212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6cb089e540814a7baea41c06f04e50c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } } }
I20260810 04:53:36.294458 6214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cb089e540814a7baea41c06f04e50c6. Latest consensus state: current_term: 2 leader_uuid: "6cb089e540814a7baea41c06f04e50c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } } }
I20260810 04:53:36.294589 6214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:36.294543 6212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:36.294920 6223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:36.295929 6223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:36.296137 6223 catalog_manager.cc:1259] Loaded cluster ID: 516f816d2f554b4fa9ea8d1581552ed5
I20260810 04:53:36.296346 6223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:53:36.296684 6223 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 04:53:36.301329 6223 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 04:53:36.304296 6223 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:36.304579 6223 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Loaded TSK: 0
I20260810 04:53:36.304826 6223 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:53:36.372792 6208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:36.373102 6208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:36.373148 6208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:36.374410 6208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:36.374485 6208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:36.374536 6208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:53:36.376256 6208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:39881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=38443
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:36.376595 6208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:36.376876 6208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:36.382970 6245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:36.382982 6247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:36.383102 6249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:36.383641 6208 server_base.cc:1034] running on GCE node
I20260810 04:53:36.383909 6208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:36.384272 6208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:36.385493 6208 hybrid_clock.cc:648] HybridClock initialized: now 1786337616385463 us; error 45 us; skew 500 ppm
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:36.388717 6208 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:53:36.389338 6208 webserver.cc:460] Webserver started at http://127.15.239.193:38443/ using document root <none> and password file <none>
I20260810 04:53:36.389618 6208 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:36.389719 6208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:36.391304 6208 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:53:36.392112 6257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.392297 6208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:36.392416 6208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "0c31cfd714374e27afca6f7b8ad5fdf3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "b98aa24325925144a8cb2a23c443a7ca"
server_key_iv: "df4509a8db3979b9aa720ebef54b89b2"
server_key_version: "encryptionkey@0"
I20260810 04:53:36.392855 6208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:36.413210 6208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:36.415689 6208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:36.415866 6208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:36.416232 6208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:36.416877 6272 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:53:36.418622 6208 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:53:36.418675 6208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:53:36.418715 6208 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:53:36.419559 6208 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:53:36.419608 6208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:53:36.419667 6272 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap starting.
I20260810 04:53:36.429548 6208 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:39881
I20260810 04:53:36.430220 6208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:53:36.430864 6435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:39881 every 8 connection(s)
I20260810 04:53:36.434763 6272 log.cc:824] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:36.437995 6272 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:53:36.438330 6272 tablet_bootstrap.cc:492] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap complete.
I20260810 04:53:36.439772 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 6208
I20260810 04:53:36.440104 6272 ts_tablet_manager.cc:1397] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.012s
I20260810 04:53:36.440165 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:36373
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:37779
--webserver_port=35301
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:36.442472 6272 raft_consensus.cc:348] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.442807 6272 raft_consensus.cc:729] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c31cfd714374e27afca6f7b8ad5fdf3, State: Initialized, Role: FOLLOWER
I20260810 04:53:36.442958 6272 consensus_queue.cc:260] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.443638 6272 ts_tablet_manager.cc:1428] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 04:53:36.447196 6439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.431239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:51579)
0810 04:53:36.431477 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.431528 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.432585 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.435695 (+ 3110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.435699 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.436145 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:36.436368 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.436375 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.437586 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.437587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.438613 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.438616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.439260 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.439261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.439419 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.440180 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:36.440206 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:36.442341 (+ 2135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:36.445275 (+ 2934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.445283 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.445286 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.445625 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.445980 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.445981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.445981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.446103 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.446628 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:36.446635 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:36.446764 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.446861 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.447023 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":144,"threads_started":1}
I20260810 04:53:36.447842 6440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.431350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:51579 (local address 127.15.239.254:37779)
0810 04:53:36.435144 (+ 3794us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.435155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.435207 (+ 52us) server_negotiation.cc:407] Connection header received
0810 04:53:36.435393 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.435403 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.435474 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.435657 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:36.436500 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.437454 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.438715 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.439149 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.439283 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.442482 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:36.442489 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:36.442489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:36.442506 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:36.445172 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.445730 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.445734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.445734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.445883 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.446201 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.446202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.446202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.446549 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:36.446637 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.446984 (+ 347us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.447155 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3719,"thread_start_us":111,"threads_started":1}
I20260810 04:53:36.448684 6436 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37779
I20260810 04:53:36.448848 6436 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:36.449095 6436 heartbeater.cc:511] Master 127.15.239.254:37779 requested a full tablet report, sending...
I20260810 04:53:36.450024 6154 ts_manager.cc:194] Registered new tserver with Master: 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193:39881)
I20260810 04:53:36.451251 6154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:51579
I20260810 04:53:36.452411 6436 heartbeater.cc:503] Master 127.15.239.254:37779 was elected leader, sending a full tablet report...
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:53:36.460886 6447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.450996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34668 (local address 127.15.239.193:39881)
0810 04:53:36.451184 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.451189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.451203 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:53:36.451303 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.451305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.451324 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.451410 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:36.452152 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.453184 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.454433 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.454742 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.454809 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.457601 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:36.457618 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:36.457618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:36.457626 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:36.459329 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.459804 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.459807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.459807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.459877 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.460140 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.460141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.460141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.460335 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:36.460435 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.460670 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.460779 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":122,"threads_started":1}
I20260810 04:53:36.460887 6444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.450780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39881 (local address 127.0.0.1:34668)
0810 04:53:36.451064 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.451107 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.451194 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.451497 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.451506 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.451946 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:36.452056 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.452059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.453271 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.453272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.454328 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.454332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.454840 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.454842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.454944 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.455584 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:36.455590 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:36.457474 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:36.459452 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.459460 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.459463 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.459703 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.459960 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.459961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.459962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.460073 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.460423 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:36.460432 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:36.460493 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.460612 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.460771 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":136,"threads_started":1}
I20260810 04:53:36.461599 6342 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bb404ffef2e45dabab7f5fde4f2570b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:34668
I20260810 04:53:36.462267 6448 tablet_replica.cc:330] stopping tablet replica
I20260810 04:53:36.462419 6448 raft_consensus.cc:2229] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:36.462524 6448 raft_consensus.cc:2258] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:36.462999 6448 ts_tablet_manager.cc:1905] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:36.465668 6448 ts_tablet_manager.cc:1918] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:36.465756 6448 log.cc:1196] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/1bb404ffef2e45dabab7f5fde4f2570b
I20260810 04:53:36.466015 6448 ts_tablet_manager.cc:1939] T 1bb404ffef2e45dabab7f5fde4f2570b P 0c31cfd714374e27afca6f7b8ad5fdf3: Deleting consensus metadata
I20260810 04:53:36.466667 6132 catalog_manager.cc:4841] TS 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193:39881): tablet 1bb404ffef2e45dabab7f5fde4f2570b (table test-table [id=ec543acc922444c890e78a398bf2d6ef]) successfully deleted
W20260810 04:53:36.544348 6442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:36.544605 6442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:36.544629 6442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:36.545781 6442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:36.545818 6442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:36.545845 6442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:53:36.547423 6442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:36373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=35301
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:36.547744 6442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:36.548056 6442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:36.554332 6454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:36.554280 6455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:36.554425 6442 server_base.cc:1034] running on GCE node
W20260810 04:53:36.554263 6459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:36.555011 6442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:36.555315 6442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:36.556502 6442 hybrid_clock.cc:648] HybridClock initialized: now 1786337616556485 us; error 46 us; skew 500 ppm
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:36.559679 6442 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:53:36.560256 6442 webserver.cc:460] Webserver started at http://127.15.239.194:35301/ using document root <none> and password file <none>
I20260810 04:53:36.560503 6442 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:36.560563 6442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:36.562139 6442 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:53:36.562811 6466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.563033 6442 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:53:36.563159 6442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "d60a66ff201c92f141a6c3c70739363d"
server_key_iv: "793c86279c3a49bc55a9485e999935f4"
server_key_version: "encryptionkey@0"
I20260810 04:53:36.563808 6442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:36.612412 6442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:36.615799 6442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:36.616048 6442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:36.616365 6442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:36.616830 6442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:36.616892 6442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.616928 6442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:36.616947 6442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.626065 6442 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:36373
I20260810 04:53:36.626159 6636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:36373 every 8 connection(s)
I20260810 04:53:36.626677 6442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:53:36.634186 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 6442
I20260810 04:53:36.634578 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:42381
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:37779
--webserver_port=42089
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:36.641798 6440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.627742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:47439 (local address 127.15.239.254:37779)
0810 04:53:36.627841 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.627844 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.628352 (+ 508us) server_negotiation.cc:407] Connection header received
0810 04:53:36.629387 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.629389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.629405 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.629474 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:36.631278 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.632426 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.634567 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.634913 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.634999 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.638289 (+ 3290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:36.638294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:36.638294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:36.638310 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:36.639955 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.640586 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.640588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.640588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.640660 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.640967 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.640968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.640968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.641109 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:36.641192 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.641565 (+ 373us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.641681 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:53:36.642042 6641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.627723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:47439)
0810 04:53:36.628127 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.628211 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.629233 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.629599 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.629605 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.630738 (+ 1133us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:36.631160 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.631168 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.632585 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.632587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.634449 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.634454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.635031 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.635033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.635264 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.636130 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:36.636144 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:36.638168 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:36.640089 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.640098 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.640102 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.640467 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.640734 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.640735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.640735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.640905 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.641181 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:36.641190 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:36.641407 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.641530 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.641735 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":239,"threads_started":1}
I20260810 04:53:36.642638 6637 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37779
I20260810 04:53:36.642765 6637 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:36.643024 6637 heartbeater.cc:511] Master 127.15.239.254:37779 requested a full tablet report, sending...
I20260810 04:53:36.643530 6154 ts_manager.cc:194] Registered new tserver with Master: c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373)
I20260810 04:53:36.643980 6154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:47439
W20260810 04:53:36.738204 6642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:36.738461 6642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:36.738487 6642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:36.739753 6642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:36.739802 6642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:36.739830 6642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:53:36.741436 6642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:42381
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=42089
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:36.741726 6642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:36.742012 6642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:36.748026 6652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:36.748119 6649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:36.748121 6648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:36.748208 6642 server_base.cc:1034] running on GCE node
I20260810 04:53:36.748500 6642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:36.748745 6642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:36.749941 6642 hybrid_clock.cc:648] HybridClock initialized: now 1786337616749917 us; error 37 us; skew 500 ppm
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:36.753316 6642 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:53:36.753938 6642 webserver.cc:460] Webserver started at http://127.15.239.195:42089/ using document root <none> and password file <none>
I20260810 04:53:36.754216 6642 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:36.754314 6642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:36.755950 6642 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:53:36.756691 6662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.756892 6642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:53:36.757018 6642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "20fd251a81274fc68620e0aef9463287"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "74416b336946df7a1415cfd9463f48d3"
server_key_iv: "0a1ad79d7d2ed08e45acefdcd114b0d4"
server_key_version: "encryptionkey@0"
I20260810 04:53:36.757470 6642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:36.766325 6642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:36.768422 6642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:36.768607 6642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:36.768858 6642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:36.769217 6642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:36.769272 6642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.769318 6642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:36.769343 6642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:36.776533 6642 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:42381
I20260810 04:53:36.776582 6817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:42381 every 8 connection(s)
I20260810 04:53:36.776986 6642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:53:36 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337616, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:36.784971 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 6642
I20260810 04:53:36.787997 6440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.777815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:34409 (local address 127.15.239.254:37779)
0810 04:53:36.777898 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.777901 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.778186 (+ 285us) server_negotiation.cc:407] Connection header received
0810 04:53:36.778764 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.778766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.778784 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.778840 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:36.780046 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.780611 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.781731 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.781955 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.782018 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.784479 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:36.784481 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:36.784481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:36.784494 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:36.786431 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.786899 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.786900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.786901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.786967 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.787252 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.787252 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.787253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.787362 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:36.787417 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.787774 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.787866 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:53:36.788159 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.777811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:34409)
0810 04:53:36.778039 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.778081 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.778665 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.778904 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.778909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.779673 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:36.779922 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.779927 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.780725 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.780726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.781637 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.781640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.782041 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.782042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.782162 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.782734 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:36.782743 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:36.784381 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:36.786521 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.786527 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.786530 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.786821 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.787037 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:36.787038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:36.787038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:36.787185 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:36.787427 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:36.787433 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:36.787623 (+ 190us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.787729 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.787866 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260810 04:53:36.788725 6818 heartbeater.cc:347] Connected to a master server at 127.15.239.254:37779
I20260810 04:53:36.788858 6818 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:36.789070 6818 heartbeater.cc:511] Master 127.15.239.254:37779 requested a full tablet report, sending...
I20260810 04:53:36.789582 6154 ts_manager.cc:194] Registered new tserver with Master: 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
I20260810 04:53:36.789991 6154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:34409
I20260810 04:53:36.793081 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.785484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51492 (local address 127.15.239.254:37779)
0810 04:53:36.785643 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.785645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.785722 (+ 77us) server_negotiation.cc:407] Connection header received
0810 04:53:36.785808 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.785809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.785821 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.785895 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:36.786748 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.787543 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.788686 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.788953 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.789029 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.790399 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:36.790401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:36.790401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:36.790408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:36.791754 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.792195 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.792196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.792196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.792265 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:36.792484 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:36.792485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:36.792485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:36.792603 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:36.792830 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.792868 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.792967 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260810 04:53:36.794093 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:53:36.797464 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.794553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51494 (local address 127.15.239.254:37779)
0810 04:53:36.794608 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.794610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.794812 (+ 202us) server_negotiation.cc:407] Connection header received
0810 04:53:36.794872 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.794873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.794928 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.795012 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:53:36.795118 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.795670 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.796550 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.796835 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.796918 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.797098 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:53:36.797228 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:53:36.797325 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.797345 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.797369 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:53:36.797817 6154 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51494:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:53:36.799853 6154 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:53:36.802811 6342 tablet_service.cc:1467] Processing CreateTablet for tablet 2bef0da5bcbc479bab1455454eed6f7b (DEFAULT_TABLE table=test-table [id=12b89e8f56834f029e8d6bb48363969c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:36.803107 6342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bef0da5bcbc479bab1455454eed6f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:36.805084 6272 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap starting.
I20260810 04:53:36.805578 6272 tablet_bootstrap.cc:654] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:36.806334 6272 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: No bootstrap required, opened a new log
I20260810 04:53:36.806403 6272 ts_tablet_manager.cc:1397] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 04:53:36.806798 6272 raft_consensus.cc:348] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.806906 6272 raft_consensus.cc:374] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:36.806969 6272 raft_consensus.cc:729] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c31cfd714374e27afca6f7b8ad5fdf3, State: Initialized, Role: FOLLOWER
I20260810 04:53:36.807029 6272 consensus_queue.cc:260] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.807181 6272 ts_tablet_manager.cc:1428] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:53:36.807718 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.802521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41006 (local address 127.15.239.195:42381)
0810 04:53:36.802749 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.802755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.802829 (+ 74us) server_negotiation.cc:407] Connection header received
0810 04:53:36.802910 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.802913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.802934 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.803034 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:36.803511 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.804608 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.806365 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.807138 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.807211 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.807276 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.807514 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.807563 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":120,"threads_started":1}
I20260810 04:53:36.807997 6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.802309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:42381 (local address 127.0.0.1:41006)
0810 04:53:36.802720 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.802730 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.802820 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.803089 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.803091 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.803093 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:36.803427 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.803430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.804763 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.804764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.806264 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.806268 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.807311 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.807312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.807380 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.807404 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.807839 (+ 435us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.807900 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":71,"threads_started":1}
I20260810 04:53:36.808944 6738 tablet_service.cc:1467] Processing CreateTablet for tablet 2bef0da5bcbc479bab1455454eed6f7b (DEFAULT_TABLE table=test-table [id=12b89e8f56834f029e8d6bb48363969c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:36.809108 6444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.802163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36373 (local address 127.0.0.1:49878)
0810 04:53:36.802251 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.802267 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.802323 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.805402 (+ 3079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.805403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.805405 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:36.805457 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.805459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.806844 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.806845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.807927 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.807930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.808832 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.808833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.808917 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.808922 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.808982 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.809034 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 04:53:36.809131 6826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.802393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.15.239.194:36373)
0810 04:53:36.805185 (+ 2792us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.805190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.805203 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:53:36.805251 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.805254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.805272 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.805545 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:36.805654 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.806716 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.808067 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.808741 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.808836 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.808893 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.808998 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.809042 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2733,"thread_start_us":133,"threads_started":1}
I20260810 04:53:36.809430 6738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bef0da5bcbc479bab1455454eed6f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:36.809930 6544 tablet_service.cc:1467] Processing CreateTablet for tablet 2bef0da5bcbc479bab1455454eed6f7b (DEFAULT_TABLE table=test-table [id=12b89e8f56834f029e8d6bb48363969c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:36.810225 6544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bef0da5bcbc479bab1455454eed6f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:36.813148 6831 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Bootstrap starting.
I20260810 04:53:36.813421 6832 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Bootstrap starting.
I20260810 04:53:36.814050 6831 tablet_bootstrap.cc:654] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:36.814193 6832 tablet_bootstrap.cc:654] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:36.814946 6832 log.cc:824] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:36.814946 6831 log.cc:824] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:36.815814 6832 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: No bootstrap required, opened a new log
I20260810 04:53:36.815842 6831 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: No bootstrap required, opened a new log
I20260810 04:53:36.815881 6832 ts_tablet_manager.cc:1397] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:53:36.815940 6831 ts_tablet_manager.cc:1397] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:53:36.817438 6831 raft_consensus.cc:348] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.817617 6831 raft_consensus.cc:374] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:36.817523 6832 raft_consensus.cc:348] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.817667 6831 raft_consensus.cc:729] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fd251a81274fc68620e0aef9463287, State: Initialized, Role: FOLLOWER
I20260810 04:53:36.817674 6832 raft_consensus.cc:374] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:36.817713 6832 raft_consensus.cc:729] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5faa504780b44ad89c8dc7a7dc88be3, State: Initialized, Role: FOLLOWER
I20260810 04:53:36.817847 6831 consensus_queue.cc:260] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.817904 6832 consensus_queue.cc:260] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.818248 6832 ts_tablet_manager.cc:1428] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 04:53:36.818212 6831 ts_tablet_manager.cc:1428] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 04:53:36.818334 6637 heartbeater.cc:503] Master 127.15.239.254:37779 was elected leader, sending a full tablet report...
I20260810 04:53:36.818214 6818 heartbeater.cc:503] Master 127.15.239.254:37779 was elected leader, sending a full tablet report...
I20260810 04:53:36.821424 6443 raft_consensus.cc:482] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:36.821584 6443 raft_consensus.cc:504] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.822011 6443 leader_election.cc:288] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
I20260810 04:53:36.825491 6826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.822274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:48169 (local address 127.15.239.194:36373)
0810 04:53:36.822339 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.822341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.822352 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:53:36.822427 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.822428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.822437 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.822484 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:36.822699 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.823206 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.824671 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.825070 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.825167 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.825178 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.825376 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.825419 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:53:36.825537 6439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.822199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36373 (local address 127.15.239.193:48169)
0810 04:53:36.822265 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.822280 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.822339 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.822492 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.822493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.822495 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:36.822621 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.822624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.823285 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.823286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.824584 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.824588 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.825165 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.825166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.825268 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.825286 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.825366 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.825419 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":14}
I20260810 04:53:36.825875 6827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.822582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:55641 (local address 127.15.239.195:42381)
0810 04:53:36.822648 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.822650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.822803 (+ 153us) server_negotiation.cc:407] Connection header received
0810 04:53:36.822866 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.822867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.822877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.822943 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:36.823108 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.823805 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.825087 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.825484 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.825570 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.825579 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.825766 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.825814 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:53:36.825922 6841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.822332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:42381 (local address 127.15.239.193:55641)
0810 04:53:36.822743 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.822752 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:36.822814 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:36.822946 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:36.822947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:36.822948 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:36.823040 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.823041 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.823900 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.823901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.824995 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:36.824997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.825582 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.825583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:36.825671 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.825675 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:53:36.825754 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 04:53:36.825802 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":131,"threads_started":1}
I20260810 04:53:36.825943 6570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bef0da5bcbc479bab1455454eed6f7b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" is_pre_election: true
I20260810 04:53:36.826108 6570 raft_consensus.cc:2454] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 0.
I20260810 04:53:36.826272 6760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bef0da5bcbc479bab1455454eed6f7b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fd251a81274fc68620e0aef9463287" is_pre_election: true
I20260810 04:53:36.826385 6261 leader_election.cc:302] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3, c5faa504780b44ad89c8dc7a7dc88be3; no voters:
I20260810 04:53:36.826468 6760 raft_consensus.cc:2454] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 0.
I20260810 04:53:36.826522 6443 raft_consensus.cc:2781] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:53:36.826599 6443 raft_consensus.cc:482] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:53:36.826637 6443 raft_consensus.cc:3037] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:36.827500 6443 raft_consensus.cc:504] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.827680 6443 leader_election.cc:288] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 election: Requested vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
I20260810 04:53:36.827857 6760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bef0da5bcbc479bab1455454eed6f7b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20fd251a81274fc68620e0aef9463287"
I20260810 04:53:36.827888 6570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bef0da5bcbc479bab1455454eed6f7b" candidate_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
I20260810 04:53:36.827944 6760 raft_consensus.cc:3037] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:36.827966 6570 raft_consensus.cc:3037] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:36.828819 6570 raft_consensus.cc:2454] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 1.
I20260810 04:53:36.828823 6760 raft_consensus.cc:2454] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c31cfd714374e27afca6f7b8ad5fdf3 in term 1.
I20260810 04:53:36.828994 6261 leader_election.cc:302] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3, c5faa504780b44ad89c8dc7a7dc88be3; no voters:
I20260810 04:53:36.829106 6443 raft_consensus.cc:2781] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:36.829319 6443 raft_consensus.cc:686] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 LEADER]: Becoming Leader. State: Replica: 0c31cfd714374e27afca6f7b8ad5fdf3, State: Running, Role: LEADER
I20260810 04:53:36.829414 6443 consensus_queue.cc:237] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:36.830350 6154 catalog_manager.cc:5495] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } health_report { overall_health: HEALTHY } } }
I20260810 04:53:36.845397 6447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.841211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34676 (local address 127.15.239.193:39881)
0810 04:53:36.841286 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:36.841288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:36.841304 (+ 16us) server_negotiation.cc:407] Connection header received
0810 04:53:36.841347 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:36.841348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:36.841383 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:36.841458 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:53:36.841642 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.842195 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.843219 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:36.844488 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:36.844559 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:36.844842 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:53:36.845046 (+ 204us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:53:36.845139 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:36.845210 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 04:53:36.845241 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:53:36.847738 6760 raft_consensus.cc:1261] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Refusing update from remote peer 0c31cfd714374e27afca6f7b8ad5fdf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:36.847774 6570 raft_consensus.cc:1261] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Refusing update from remote peer 0c31cfd714374e27afca6f7b8ad5fdf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:36.848217 6443 consensus_queue.cc:1035] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:36.848397 6842 consensus_queue.cc:1035] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:36.852380 6846 mvcc.cc:205] Tried to move back new op lower bound from 7316838878605000704 to 7316838878534119424. Current Snapshot: MvccSnapshot[applied={T|T < 7316838878605000704}]
I20260810 04:53:36.852735 6845 mvcc.cc:205] Tried to move back new op lower bound from 7316838878605000704 to 7316838878534119424. Current Snapshot: MvccSnapshot[applied={T|T < 7316838878605000704}]
I20260810 04:53:36.854635 6151 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:36.854741 6151 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:36.855672 6151 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Sending DeleteTablet for 3 replicas of tablet 2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:36.856082 6342 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bef0da5bcbc479bab1455454eed6f7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:34668
I20260810 04:53:36.856127 6544 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bef0da5bcbc479bab1455454eed6f7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:49878
I20260810 04:53:36.856197 6448 tablet_replica.cc:330] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: stopping tablet replica
I20260810 04:53:36.856249 6448 raft_consensus.cc:2229] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:53:36.856338 6448 raft_consensus.cc:2258] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:36.856370 6854 tablet_replica.cc:330] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: stopping tablet replica
I20260810 04:53:36.856397 6738 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bef0da5bcbc479bab1455454eed6f7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:36 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:41006
I20260810 04:53:36.856480 6854 raft_consensus.cc:2229] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:36.856599 6854 raft_consensus.cc:2258] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:36.856662 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 6208
I20260810 04:53:36.868973 6855 tablet_replica.cc:330] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: stopping tablet replica
I20260810 04:53:36.869206 6855 raft_consensus.cc:2229] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:36.869374 6855 raft_consensus.cc:2258] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:36.871352 6855 ts_tablet_manager.cc:1905] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:36.873057 6854 ts_tablet_manager.cc:1905] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:36.873806 6855 ts_tablet_manager.cc:1918] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:36.873911 6855 log.cc:1196] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:36.874257 6855 ts_tablet_manager.cc:1939] T 2bef0da5bcbc479bab1455454eed6f7b P 20fd251a81274fc68620e0aef9463287: Deleting consensus metadata
I20260810 04:53:36.874835 6854 ts_tablet_manager.cc:1918] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:36.874944 6854 log.cc:1196] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:36.874930 6132 catalog_manager.cc:4841] TS 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381): tablet 2bef0da5bcbc479bab1455454eed6f7b (table test-table [id=12b89e8f56834f029e8d6bb48363969c]) successfully deleted
I20260810 04:53:36.875236 6854 ts_tablet_manager.cc:1939] T 2bef0da5bcbc479bab1455454eed6f7b P c5faa504780b44ad89c8dc7a7dc88be3: Deleting consensus metadata
I20260810 04:53:36.875733 6132 catalog_manager.cc:4841] TS c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373): tablet 2bef0da5bcbc479bab1455454eed6f7b (table test-table [id=12b89e8f56834f029e8d6bb48363969c]) successfully deleted
W20260810 04:53:36.879503 6132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:39881 (error 108)
I20260810 04:53:36.879805 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 6442
I20260810 04:53:36.884006 6444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:36.883790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:39881 (local address 127.0.0.1:34692)
0810 04:53:36.883870 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:36.883942 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:39881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 04:53:36.884332 6132 catalog_manager.cc:4584] TS 0c31cfd714374e27afca6f7b8ad5fdf3 (127.15.239.193:39881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2bef0da5bcbc479bab1455454eed6f7b: Network error: Client connection negotiation failed: client connection to 127.15.239.193:39881: connect: Connection refused (error 111)
I20260810 04:53:36.894380 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 6642
I20260810 04:53:36.915575 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 6103
I20260810 04:53:36.928653 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37779
--webserver_interface=127.15.239.254
--webserver_port=38851
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:37779
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:37.025535 6858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:37.025842 6858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:37.025889 6858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:37.027141 6858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:37.027211 6858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:37.027240 6858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:37.027271 6858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:37.027297 6858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:37.029022 6858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:37779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:37779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=38851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:37.029347 6858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:37.029630 6858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:37.035290 6864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.035305 6863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.035426 6866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:37.035308 6858 server_base.cc:1034] running on GCE node
I20260810 04:53:37.035761 6858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:37.036159 6858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:37.037326 6858 hybrid_clock.cc:648] HybridClock initialized: now 1786337617037300 us; error 48 us; skew 500 ppm
Aug 10 04:53:37 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337617, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:37.040449 6858 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:37.040911 6858 webserver.cc:460] Webserver started at http://127.15.239.254:38851/ using document root <none> and password file <none>
I20260810 04:53:37.041170 6858 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:37.041219 6858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:37.042719 6858 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:37.043506 6874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.043715 6858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:37.043815 6858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "6cb089e540814a7baea41c06f04e50c6"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "1e95b7936683d98d5b465c210fee42a1"
server_key_iv: "30811a418ee63bcea2ad824b4d5a80e1"
server_key_version: "encryptionkey@0"
I20260810 04:53:37.044296 6858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:37.063256 6858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:37.065840 6858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:37.065996 6858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:37.070770 6858 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:37779
I20260810 04:53:37.070825 6950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:37779 every 8 connection(s)
I20260810 04:53:37.071286 6858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:37.073335 6951 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:53:37.074033 6951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap starting.
I20260810 04:53:37.075872 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 6858
I20260810 04:53:37.076251 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:39881
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:37779
--webserver_port=38443
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:53:37.085567 6951 log.cc:824] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:37.088814 6951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:53:37.089262 6951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6: Bootstrap complete.
I20260810 04:53:37.092238 6951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:37.092555 6951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cb089e540814a7baea41c06f04e50c6, State: Initialized, Role: FOLLOWER
I20260810 04:53:37.092805 6951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:37.092941 6951 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:37.093007 6951 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:37.093068 6951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 04:53:37.094304 6951 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:37.094451 6951 leader_election.cc:302] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cb089e540814a7baea41c06f04e50c6; no voters:
I20260810 04:53:37.094724 6951 leader_election.cc:288] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 04:53:37.094771 6955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 04:53:37.094929 6955 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [term 3 LEADER]: Becoming Leader. State: Replica: 6cb089e540814a7baea41c06f04e50c6, State: Running, Role: LEADER
I20260810 04:53:37.095036 6955 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } }
I20260810 04:53:37.095117 6951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:37.095367 6955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cb089e540814a7baea41c06f04e50c6. Latest consensus state: current_term: 3 leader_uuid: "6cb089e540814a7baea41c06f04e50c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } } }
I20260810 04:53:37.095441 6955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:37.095389 6956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6cb089e540814a7baea41c06f04e50c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cb089e540814a7baea41c06f04e50c6" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 37779 } } }
I20260810 04:53:37.095566 6956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cb089e540814a7baea41c06f04e50c6 [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:37.095728 6961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:37.096930 6961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:37.097079 6961 catalog_manager.cc:1259] Loaded cluster ID: 516f816d2f554b4fa9ea8d1581552ed5
I20260810 04:53:37.097141 6961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 04:53:37.100455 6961 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8d4fec69ad google::LogMessage::Fail() at ??:0
@ 0x7f8d4fec988a google::LogMessage::SendToLog() at ??:0
@ 0x7f8d4fec64de google::LogMessage::Flush() at ??:0
@ 0x7f8d4fec7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8d57de70f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f8d57df08b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8d51d940d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8d51d89954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8d52bed6db start_thread at ??:0
@ 0x7f8d4e9c461f clone at ??:0
W20260810 04:53:37.189392 6953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:37.189646 6953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:37.189674 6953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:37.190917 6953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:37.190961 6953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:37.190990 6953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:53:37.192660 6953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:39881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=38443
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:37.192986 6953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:37.193281 6953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:37.200389 7001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.200402 7003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.200403 6998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:37.200840 6953 server_base.cc:1034] running on GCE node
I20260810 04:53:37.201108 6953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:37.201432 6953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:37.202646 6953 hybrid_clock.cc:648] HybridClock initialized: now 1786337617202623 us; error 37 us; skew 500 ppm
Aug 10 04:53:37 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337617, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:37.206413 6953 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:53:37.207120 6953 webserver.cc:460] Webserver started at http://127.15.239.193:38443/ using document root <none> and password file <none>
I20260810 04:53:37.207485 6953 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:37.207583 6953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:37.209782 6953 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:37.210747 7014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.211035 6953 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:37.211158 6953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "0c31cfd714374e27afca6f7b8ad5fdf3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "b98aa24325925144a8cb2a23c443a7ca"
server_key_iv: "df4509a8db3979b9aa720ebef54b89b2"
server_key_version: "encryptionkey@0"
I20260810 04:53:37.211710 6953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:37.225471 6953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:37.228262 6953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:37.228459 6953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:37.228737 6953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:37.229303 7026 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:53:37.231655 6953 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:53:37.231735 6953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260810 04:53:37.231793 6953 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:53:37.232635 6953 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:53:37.232694 6953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:53:37.232784 7026 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap starting.
I20260810 04:53:37.240907 6953 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:39881
I20260810 04:53:37.241135 7194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:39881 every 8 connection(s)
I20260810 04:53:37.246423 7026 log.cc:824] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:37.247350 6953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:53:37.250437 7026 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:53:37.250875 7026 tablet_bootstrap.cc:492] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Bootstrap complete.
I20260810 04:53:37.252234 7026 ts_tablet_manager.cc:1397] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.017s
I20260810 04:53:37.253940 7026 raft_consensus.cc:348] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:37.254407 7026 raft_consensus.cc:729] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c31cfd714374e27afca6f7b8ad5fdf3, State: Initialized, Role: FOLLOWER
I20260810 04:53:37.254588 7026 consensus_queue.cc:260] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:37.254931 7026 ts_tablet_manager.cc:1428] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 04:53:37.255462 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 6953
I20260810 04:53:37.255861 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:36373
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:37779
--webserver_port=35301
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:37.327381 7198 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:53:37.248772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:48697)
0810 04:53:37.249450 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.249536 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:37.250654 (+ 1118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:37.327080 (+ 76426us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":110,"threads_started":1}
W20260810 04:53:37.327708 7196 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:37779 (0 consecutive failures): Network error: Failed to ping master at 127.15.239.254:37779: Client connection negotiation failed: client connection to 127.15.239.254:37779: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:53:37.328151 7198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.327978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:51917)
0810 04:53:37.328055 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.328113 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 04:53:37.328567 7198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.328466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:41687)
0810 04:53:37.328517 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.328545 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:53:37.328750 7196 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:53:37.358582 7200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:37.358844 7200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:37.358870 7200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:37.360105 7200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:37.360146 7200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:37.360173 7200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:53:37.361733 7200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:36373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=35301
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:37.361958 7200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:37.362178 7200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:37.368057 7206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.368124 7210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.368083 7208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:37.368300 7200 server_base.cc:1034] running on GCE node
I20260810 04:53:37.368597 7200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:37.368939 7200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:37.370162 7200 hybrid_clock.cc:648] HybridClock initialized: now 1786337617370142 us; error 49 us; skew 500 ppm
Aug 10 04:53:37 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337617, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:37.373432 7200 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:53:37.374011 7200 webserver.cc:460] Webserver started at http://127.15.239.194:35301/ using document root <none> and password file <none>
I20260810 04:53:37.374269 7200 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:37.374341 7200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:37.376013 7200 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:53:37.376899 7223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.377164 7200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:53:37.377296 7200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c5faa504780b44ad89c8dc7a7dc88be3"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "d60a66ff201c92f141a6c3c70739363d"
server_key_iv: "793c86279c3a49bc55a9485e999935f4"
server_key_version: "encryptionkey@0"
I20260810 04:53:37.377776 7200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:37.388232 7200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:37.391067 7200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:37.391279 7200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:37.391578 7200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:37.391997 7200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:37.392113 7200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.392172 7200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:37.392225 7200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.400537 7200 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:36373
I20260810 04:53:37.400614 7400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:36373 every 8 connection(s)
I20260810 04:53:37.401041 7200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:53:37.402360 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 7200
I20260810 04:53:37.402375 7403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.401866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:57069)
0810 04:53:37.402075 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.402179 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":89,"threads_started":1}
I20260810 04:53:37.402688 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:42381
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:37779
--webserver_port=42089
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:37.402935 7401 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:37779 (0 consecutive failures): Network error: Failed to ping master at 127.15.239.254:37779: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
I20260810 04:53:37.403270 7403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.403159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:45891)
0810 04:53:37.403213 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.403242 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 04:53:37.403584 7403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.403490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:36759)
0810 04:53:37.403536 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.403560 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:53:37.403700 7401 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:53:37.501452 7404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:37.501722 7404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:37.501749 7404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:37.503000 7404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:37.503046 7404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:37.503074 7404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:53:37.504702 7404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:42381
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=42089
--tserver_master_addrs=127.15.239.254:37779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:37.505005 7404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:37.505307 7404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:37.511447 7413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:37.511480 7412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:37.511574 7404 server_base.cc:1034] running on GCE node
W20260810 04:53:37.511700 7417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:37.511950 7404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:37.512264 7404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:37.513437 7404 hybrid_clock.cc:648] HybridClock initialized: now 1786337617513407 us; error 57 us; skew 500 ppm
Aug 10 04:53:37 dist-test-slave-kvfs krb5kdc[5302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337617, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:37.516562 7404 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:53:37.517222 7404 webserver.cc:460] Webserver started at http://127.15.239.195:42089/ using document root <none> and password file <none>
I20260810 04:53:37.517488 7404 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:37.517544 7404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:37.519100 7404 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 04:53:37.519903 7432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.520089 7404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:37.520193 7404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "20fd251a81274fc68620e0aef9463287"
format_stamp: "Formatted at 2026-08-10 04:53:35 on dist-test-slave-kvfs"
server_key: "74416b336946df7a1415cfd9463f48d3"
server_key_iv: "0a1ad79d7d2ed08e45acefdcd114b0d4"
server_key_version: "encryptionkey@0"
I20260810 04:53:37.520682 7404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:37.533619 7404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:37.536408 7404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:37.536592 7404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:37.536943 7404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:37.537485 7404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:37.537545 7404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.537600 7404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:37.537635 7404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:37.545398 7404 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:42381
I20260810 04:53:37.545475 7607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:42381 every 8 connection(s)
I20260810 04:53:37.545912 7404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:53:37.547346 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.546863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:38043)
0810 04:53:37.547057 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.547152 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
W20260810 04:53:37.547880 7608 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:37779 (0 consecutive failures): Network error: Failed to ping master at 127.15.239.254:37779: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
I20260810 04:53:37.548247 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.548145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:33185)
0810 04:53:37.548196 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.548227 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 04:53:37.548559 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:37.548494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:37661)
0810 04:53:37.548527 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:37.548546 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260810 04:53:37.548691 7608 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:53:37.551002 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 7404
I20260810 04:53:38.329733 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.329360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:54669)
0810 04:53:38.329569 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:38.329630 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":90,"threads_started":1}
I20260810 04:53:38.404448 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.404174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:46979)
0810 04:53:38.404330 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:38.404376 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260810 04:53:38.549332 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.549079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:53129)
0810 04:53:38.549223 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:38.549263 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260810 04:53:38.556578 7617 raft_consensus.cc:482] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:38.556802 7617 raft_consensus.cc:504] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:38.557238 7617 leader_election.cc:288] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
Aug 10 04:53:38 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337617, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.194@KRBTEST.COM
Aug 10 04:53:38 dist-test-slave-kvfs krb5kdc[5302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337617, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.195@KRBTEST.COM
I20260810 04:53:38.569715 7619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.557610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:35001 (local address 127.15.239.194:36373)
0810 04:53:38.557813 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:38.557827 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:38.557873 (+ 46us) server_negotiation.cc:407] Connection header received
0810 04:53:38.558618 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:38.558622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:38.558692 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:38.558876 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:38.559761 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.560764 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.561870 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.562329 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.562466 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:38.565630 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:38.565637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:38.565638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:38.565653 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:38.567698 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568261 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:38.568264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:38.568264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:38.568367 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568664 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:38.568669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:38.568670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:38.568956 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:38.569075 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:38.569424 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 04:53:38.569571 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":82,"threads_started":1}
I20260810 04:53:38.569701 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.557451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36373 (local address 127.15.239.193:35001)
0810 04:53:38.557570 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:38.557587 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:38.557679 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:38.558931 (+ 1252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:38.558933 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:38.559376 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:38.559607 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:38.559614 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.560883 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.560884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:38.561769 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:38.561771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.562431 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.562432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:38.562559 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:38.563315 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:38.563327 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:38.565450 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:38.567792 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:38.567799 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:38.567802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:38.568176 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:38.568447 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568449 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:38.568449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:38.568577 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:38.569063 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:38.569070 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:38.569240 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 04:53:38.569362 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 04:53:38.569571 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":9}
I20260810 04:53:38.569888 7620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.557701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:35485 (local address 127.15.239.195:42381)
0810 04:53:38.557858 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:38.557866 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:38.557901 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:53:38.558618 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:38.558622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:38.558692 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:38.558877 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:38.559749 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.560769 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.561941 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.562379 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.562513 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:38.566025 (+ 3512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:38.566029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:38.566030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:38.566044 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:38.568309 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568659 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:38.568662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:38.568663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:38.568772 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568995 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:38.568996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:38.568996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:38.569310 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:38.569435 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:38.569625 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 04:53:38.569770 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260810 04:53:38.569808 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:38.557610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:42381 (local address 127.15.239.193:35485)
0810 04:53:38.557728 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:38.557741 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:38.557803 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:38.559052 (+ 1249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:38.559053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:38.559350 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:38.559607 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:38.559614 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.560903 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.560904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:38.561770 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:38.561773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:38.562482 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:38.562483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:38.562562 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:38.563324 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:38.563329 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:38.565900 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:38.568397 (+ 2497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:38.568399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:38.568571 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:38.568858 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:38.568859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:38.568859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:38.568922 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:38.569416 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:38.569417 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:38.569468 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 04:53:38.569561 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 04:53:38.569673 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":100,"thread_start_us":64,"threads_started":1}
W20260810 04:53:38.571388 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
W20260810 04:53:38.571511 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:38.571569 7017 leader_election.cc:302] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3; no voters: 20fd251a81274fc68620e0aef9463287, c5faa504780b44ad89c8dc7a7dc88be3
I20260810 04:53:38.571717 7617 raft_consensus.cc:2726] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:53:39.330741 7622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:39.330428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:50401)
0810 04:53:39.330620 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:39.330670 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":102,"threads_started":1}
I20260810 04:53:39.405175 7625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:39.404951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:47835)
0810 04:53:39.405090 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:39.405128 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260810 04:53:39.550299 7626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:39.549920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:45733)
0810 04:53:39.550162 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:39.550222 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":149,"threads_started":1}
I20260810 04:53:40.154842 7627 raft_consensus.cc:482] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:40.155012 7627 raft_consensus.cc:504] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:40.155274 7627 leader_election.cc:288] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
W20260810 04:53:40.155926 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
W20260810 04:53:40.155997 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:40.156078 7017 leader_election.cc:302] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3; no voters: 20fd251a81274fc68620e0aef9463287, c5faa504780b44ad89c8dc7a7dc88be3
I20260810 04:53:40.156167 7627 raft_consensus.cc:2726] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:53:40.331672 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:40.331350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:41427)
0810 04:53:40.331544 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:40.331596 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260810 04:53:40.406109 7630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:40.405778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:45993)
0810 04:53:40.405997 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:40.406044 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":86,"threads_started":1}
I20260810 04:53:40.551261 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:40.550917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:39521)
0810 04:53:40.551133 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:40.551191 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":105,"threads_started":1}
I20260810 04:53:41.332710 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:41.332424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:58557)
0810 04:53:41.332588 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:41.332638 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260810 04:53:41.407133 7636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:41.406827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:58309)
0810 04:53:41.407016 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:41.407066 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":89,"threads_started":1}
I20260810 04:53:41.552426 7637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:41.551941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:55225)
0810 04:53:41.552301 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:41.552355 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":149,"threads_started":1}
I20260810 04:53:42.333724 7638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:42.333382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:52633)
0810 04:53:42.333594 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:42.333645 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":114,"threads_started":1}
I20260810 04:53:42.408118 7639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:42.407737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:51449)
0810 04:53:42.407930 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:42.407980 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":107,"threads_started":1}
I20260810 04:53:42.553340 7640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:42.553042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:53369)
0810 04:53:42.553227 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:42.553272 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":98,"threads_started":1}
I20260810 04:53:43.334779 7641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:43.334438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:44275)
0810 04:53:43.334650 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:43.334704 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":103,"threads_started":1}
I20260810 04:53:43.409077 7643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:43.408756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:46055)
0810 04:53:43.408951 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:43.409007 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":115,"threads_started":1}
I20260810 04:53:43.507257 7645 raft_consensus.cc:482] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:43.507400 7645 raft_consensus.cc:504] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:43.507644 7645 leader_election.cc:288] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
W20260810 04:53:43.508257 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
W20260810 04:53:43.508352 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:43.508452 7017 leader_election.cc:302] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3; no voters: 20fd251a81274fc68620e0aef9463287, c5faa504780b44ad89c8dc7a7dc88be3
I20260810 04:53:43.508581 7645 raft_consensus.cc:2726] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:53:43.554352 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:43.554018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:47063)
0810 04:53:43.554219 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:43.554276 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":93,"threads_started":1}
I20260810 04:53:44.335999 7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:44.335545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:34057)
0810 04:53:44.335771 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:44.335825 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":111,"threads_started":1}
I20260810 04:53:44.410084 7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:44.409743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:59093)
0810 04:53:44.409961 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:44.410013 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":116,"threads_started":1}
I20260810 04:53:44.555409 7650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:44.555045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:36181)
0810 04:53:44.555266 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:44.555326 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":145,"threads_started":1}
I20260810 04:53:45.337064 7653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:45.336702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:35361)
0810 04:53:45.336936 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:45.336991 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":149,"threads_started":1}
I20260810 04:53:45.410991 7654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:45.410647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:57581)
0810 04:53:45.410874 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:45.410924 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":106,"threads_started":1}
I20260810 04:53:45.556506 7655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:45.556154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:52073)
0810 04:53:45.556379 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:45.556435 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":90,"threads_started":1}
I20260810 04:53:46.338145 7656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:46.337792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:51779)
0810 04:53:46.338009 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:46.338070 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":94,"threads_started":1}
I20260810 04:53:46.412225 7657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:46.411822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:47583)
0810 04:53:46.412013 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:46.412148 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":97,"threads_started":1}
I20260810 04:53:46.557461 7658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:46.557157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:47593)
0810 04:53:46.557336 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:46.557386 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":87,"threads_started":1}
I20260810 04:53:47.339051 7659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:47.338772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:44681)
0810 04:53:47.338923 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:47.338977 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260810 04:53:47.413018 7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:47.412755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:38275)
0810 04:53:47.412908 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:47.412948 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
I20260810 04:53:47.558580 7666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:47.558246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:53869)
0810 04:53:47.558452 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:47.558510 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":94,"threads_started":1}
I20260810 04:53:48.336300 7668 raft_consensus.cc:482] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:48.336445 7668 raft_consensus.cc:504] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5faa504780b44ad89c8dc7a7dc88be3" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36373 } } peers { permanent_uuid: "20fd251a81274fc68620e0aef9463287" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 42381 } } peers { permanent_uuid: "0c31cfd714374e27afca6f7b8ad5fdf3" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 39881 } }
I20260810 04:53:48.336704 7668 leader_election.cc:288] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373), 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381)
W20260810 04:53:48.337260 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5faa504780b44ad89c8dc7a7dc88be3 (127.15.239.194:36373): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
W20260810 04:53:48.337378 7017 leader_election.cc:341] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 20fd251a81274fc68620e0aef9463287 (127.15.239.195:42381): Not found: Tablet not found: 2bef0da5bcbc479bab1455454eed6f7b
I20260810 04:53:48.337417 7017 leader_election.cc:302] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c31cfd714374e27afca6f7b8ad5fdf3; no voters: 20fd251a81274fc68620e0aef9463287, c5faa504780b44ad89c8dc7a7dc88be3
I20260810 04:53:48.337522 7668 raft_consensus.cc:2726] T 2bef0da5bcbc479bab1455454eed6f7b P 0c31cfd714374e27afca6f7b8ad5fdf3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:53:48.339715 7670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:48.339518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:53611)
0810 04:53:48.339632 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:48.339667 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
I20260810 04:53:48.413981 7673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:48.413662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:45615)
0810 04:53:48.413858 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:48.413895 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
I20260810 04:53:48.559798 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:48.559407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:55167)
0810 04:53:48.559636 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:48.559694 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":93,"threads_started":1}
I20260810 04:53:49.340692 7676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:49.340321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:43545)
0810 04:53:49.340519 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:49.340574 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":86,"threads_started":1}
I20260810 04:53:49.414920 7677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:49.414612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:43189)
0810 04:53:49.414791 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:49.414849 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":85,"threads_started":1}
I20260810 04:53:49.560895 7678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:49.560579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:34875)
0810 04:53:49.560765 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:49.560821 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":97,"threads_started":1}
I20260810 04:53:50.341701 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:50.341363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:58681)
0810 04:53:50.341573 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:50.341627 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":106,"threads_started":1}
I20260810 04:53:50.415926 7681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:50.415600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:41743)
0810 04:53:50.415795 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:50.415853 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260810 04:53:50.561898 7682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:50.561569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:44217)
0810 04:53:50.561748 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:50.561824 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
I20260810 04:53:51.342671 7683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:51.342363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:47513)
0810 04:53:51.342550 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:51.342596 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":101,"threads_started":1}
I20260810 04:53:51.416865 7686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:51.416581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:52839)
0810 04:53:51.416744 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:51.416794 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260810 04:53:51.562894 7687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:51.562542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:40713)
0810 04:53:51.562765 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:51.562818 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":123,"threads_started":1}
I20260810 04:53:52.343686 7688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:52.343377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.193:48401)
0810 04:53:52.343566 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:52.343616 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260810 04:53:52.417784 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:52.417495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.194:36579)
0810 04:53:52.417671 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:52.417715 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":86,"threads_started":1}
I20260810 04:53:52.560209 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 6953
I20260810 04:53:52.569459 7690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:52.567798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:37779 (local address 127.15.239.195:46585)
0810 04:53:52.569330 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:52.569380 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:37779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1504,"thread_start_us":97,"threads_started":1}
I20260810 04:53:52.575956 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 7200
I20260810 04:53:52.585834 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 7404
2026-08-10T04:53:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18890 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:53:52 dist-test-slave-kvfs krb5kdc[7695](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:53:52 dist-test-slave-kvfs krb5kdc[7695](info): set up 2 sockets
Aug 10 04:53:52 dist-test-slave-kvfs krb5kdc[7695](info): commencing operation
krb5kdc: starting...
W20260810 04:53:53.902423 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:53:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:53:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:53:54.056623 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44087
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:44087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:54.154336 7710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:54.154706 7710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:54.154749 7710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:54.156137 7710 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 04:53:54.156200 7710 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 04:53:54.156222 7710 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 04:53:54.156242 7710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:53:54.156275 7710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:54.156303 7710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:54.156329 7710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:53:54.156354 7710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:53:54.158041 7710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:44087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:54.158372 7710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:54.158650 7710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:54.165439 7722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.165486 7720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.165645 7717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:54.165669 7710 server_base.cc:1034] running on GCE node
I20260810 04:53:54.166087 7710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:54.166477 7710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:54.167659 7710 hybrid_clock.cc:648] HybridClock initialized: now 1786337634167637 us; error 46 us; skew 500 ppm
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:54.170665 7710 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:53:54.171221 7710 webserver.cc:460] Webserver started at http://127.15.239.254:38489/ using document root <none> and password file <none>
I20260810 04:53:54.171491 7710 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:54.171567 7710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:54.171736 7710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:54.173080 7710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "9310f264ca9641378078bc6eaaef1fbe"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "956d2211cf297e7d258c9bed84d1c1e0"
server_key_iv: "46ed91fb321cda9fd71ecfaa2d1d34f1"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.173508 7710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "9310f264ca9641378078bc6eaaef1fbe"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "956d2211cf297e7d258c9bed84d1c1e0"
server_key_iv: "46ed91fb321cda9fd71ecfaa2d1d34f1"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.175087 7710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:53:54.175985 7731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.176261 7710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:54.176394 7710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "9310f264ca9641378078bc6eaaef1fbe"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "956d2211cf297e7d258c9bed84d1c1e0"
server_key_iv: "46ed91fb321cda9fd71ecfaa2d1d34f1"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.176482 7710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:54.185002 7710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:54.187101 7710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:54.187278 7710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:54.192538 7710 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:44087
I20260810 04:53:54.192584 7802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:44087 every 8 connection(s)
I20260810 04:53:54.193068 7710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:53:54.194182 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 7710
I20260810 04:53:54.194326 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:53:54.194289 7803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:54.194567 16319 external_mini_cluster.cc:1428] Setting key bf47083be50354570fa6b1c7aefbebca
I20260810 04:53:54.198246 7803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap starting.
I20260810 04:53:54.199214 7803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:54.199615 7803 log.cc:824] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:54.200616 7803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: No bootstrap required, opened a new log
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:54.203480 7803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:53:54.203708 7803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:54.203753 7803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9310f264ca9641378078bc6eaaef1fbe, State: Initialized, Role: FOLLOWER
I20260810 04:53:54.203954 7803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:53:54.204084 7803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:53:54.204150 7803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:53:54.204205 7803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:54.205072 7803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:53:54.205209 7803 leader_election.cc:302] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9310f264ca9641378078bc6eaaef1fbe; no voters:
I20260810 04:53:54.205400 7803 leader_election.cc:288] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:53:54.205482 7811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:54.205708 7811 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 LEADER]: Becoming Leader. State: Replica: 9310f264ca9641378078bc6eaaef1fbe, State: Running, Role: LEADER
I20260810 04:53:54.205750 7803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:53:54.205914 7811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:53:54.206544 7813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9310f264ca9641378078bc6eaaef1fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } } }
I20260810 04:53:54.206718 7813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:54.206768 7817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9310f264ca9641378078bc6eaaef1fbe. Latest consensus state: current_term: 1 leader_uuid: "9310f264ca9641378078bc6eaaef1fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } } }
I20260810 04:53:54.206970 7817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: This master's current role is: LEADER
I20260810 04:53:54.207252 7824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:53:54.208003 7824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:53:54.208523 7808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.195254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50026 (local address 127.15.239.254:44087)
0810 04:53:54.195465 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.195483 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.195513 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:53:54.196179 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.196189 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.196251 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.196405 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:54.197367 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.198402 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.199605 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.200204 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.200296 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.203552 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:54.203557 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:54.203558 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:54.203574 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:54.205980 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.206497 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.206501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.206502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.206644 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.207294 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.207295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.207295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.207740 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:54.207984 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.208087 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.208256 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
I20260810 04:53:54.210001 7824 catalog_manager.cc:1347] Generated new cluster ID: 490035d66322481a878350ffbbd28dad
I20260810 04:53:54.210060 7824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:53:54.217706 7824 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:53:54.218325 7824 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:53:54.223579 7824 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Generated new TSK 0
I20260810 04:53:54.223795 7824 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:53:54.267572 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44087
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:54.383924 7843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:54.384301 7843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:54.384348 7843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:54.385679 7843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:54.385756 7843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:54.385807 7843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:53:54.387511 7843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:54.387835 7843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:54.388191 7843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:54.394176 7850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.394183 7855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.394266 7851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:54.394500 7843 server_base.cc:1034] running on GCE node
I20260810 04:53:54.394744 7843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:54.395088 7843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:54.396289 7843 hybrid_clock.cc:648] HybridClock initialized: now 1786337634396270 us; error 33 us; skew 500 ppm
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:54.399508 7843 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:53:54.400110 7843 webserver.cc:460] Webserver started at http://127.15.239.193:41583/ using document root <none> and password file <none>
I20260810 04:53:54.400377 7843 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:54.400461 7843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:54.400635 7843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:54.401901 7843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "5cb756688ead4133a0df910629835442"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "7ad8ef490011f546d7b7298ae0172848"
server_key_iv: "85e32247855bfc5e9b6166193fb8ac28"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.402335 7843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "5cb756688ead4133a0df910629835442"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "7ad8ef490011f546d7b7298ae0172848"
server_key_iv: "85e32247855bfc5e9b6166193fb8ac28"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.403898 7843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:53:54.404806 7862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.405022 7843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:54.405151 7843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "5cb756688ead4133a0df910629835442"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "7ad8ef490011f546d7b7298ae0172848"
server_key_iv: "85e32247855bfc5e9b6166193fb8ac28"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.405239 7843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:54.418501 7843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:54.421192 7843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:54.421382 7843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:54.421689 7843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:54.422060 7843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:54.422118 7843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.422163 7843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:54.422209 7843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.429175 7843 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:33881
I20260810 04:53:54.429260 8022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:33881 every 8 connection(s)
I20260810 04:53:54.429663 7843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:53:54.436399 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 7843
I20260810 04:53:54.436542 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:53:54.436826 16319 external_mini_cluster.cc:1428] Setting key 50f2c5632a3bdf6cfd9d03a0ca3d0262
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:54.441473 7808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.430667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:52145 (local address 127.15.239.254:44087)
0810 04:53:54.430753 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.430756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.431052 (+ 296us) server_negotiation.cc:407] Connection header received
0810 04:53:54.431679 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.431681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.431694 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.431761 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:54.433005 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.433615 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.434735 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.434987 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.435059 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.438000 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:54.438001 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:54.438002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:54.438010 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:54.439575 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.440181 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.440183 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.440184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.440274 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.440588 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.440590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.440590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.440777 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:54.440850 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.441196 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.441318 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:53:54.441504 8028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.430638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:52145)
0810 04:53:54.430904 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:54.430951 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:54.431543 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:54.431858 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:54.431862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:54.432642 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:54.432893 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.432898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.433714 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.433715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.434639 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.434641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.435099 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.435100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.435230 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.435862 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:54.435872 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:54.437887 (+ 2015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:54.439664 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:54.439673 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:54.439676 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:54.440094 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:54.440366 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:54.440367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:54.440367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:54.440505 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:54.440870 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:54.440877 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:54.441038 (+ 161us) client_negotiation.cc:769] Sending connection context
0810 04:53:54.441133 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 04:53:54.441287 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":122,"threads_started":1}
I20260810 04:53:54.442281 8023 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44087
I20260810 04:53:54.442430 8023 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:54.442655 8023 heartbeater.cc:511] Master 127.15.239.254:44087 requested a full tablet report, sending...
I20260810 04:53:54.443321 7752 ts_manager.cc:194] Registered new tserver with Master: 5cb756688ead4133a0df910629835442 (127.15.239.193:33881)
I20260810 04:53:54.444129 7752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:52145
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:53:54.471422 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44087
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:54.571619 8032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:54.572028 8032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:54.572118 8032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:54.573477 8032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:54.573560 8032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:54.573611 8032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:53:54.575317 8032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:54.575661 8032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:54.575959 8032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:54.582617 8039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:54.582671 8032 server_base.cc:1034] running on GCE node
W20260810 04:53:54.582617 8038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.582618 8042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:54.583205 8032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:54.583496 8032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:54.584658 8032 hybrid_clock.cc:648] HybridClock initialized: now 1786337634584634 us; error 44 us; skew 500 ppm
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:54.587733 8032 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:53:54.588299 8032 webserver.cc:460] Webserver started at http://127.15.239.194:45867/ using document root <none> and password file <none>
I20260810 04:53:54.588546 8032 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:54.588594 8032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:54.588707 8032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:54.590000 8032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "39d4ef03acec448d9fe459608e4d7525"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "51e4bd3f33ed11638927058aac969a9f"
server_key_iv: "543d61ef0799072184f3e3f80e821ca4"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.590428 8032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "39d4ef03acec448d9fe459608e4d7525"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "51e4bd3f33ed11638927058aac969a9f"
server_key_iv: "543d61ef0799072184f3e3f80e821ca4"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.592097 8032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:53:54.593035 8051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.593262 8032 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:54.593372 8032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "39d4ef03acec448d9fe459608e4d7525"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "51e4bd3f33ed11638927058aac969a9f"
server_key_iv: "543d61ef0799072184f3e3f80e821ca4"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.593441 8032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:54.618024 8032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:54.620729 8032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:54.620869 8032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:54.621109 8032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:54.621510 8032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:54.621551 8032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.621577 8032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:54.621635 8032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.628551 8032 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:34825
I20260810 04:53:54.628625 8224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:34825 every 8 connection(s)
I20260810 04:53:54.629045 8032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:53:54.629706 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 8032
I20260810 04:53:54.629796 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:53:54.630119 16319 external_mini_cluster.cc:1428] Setting key 7bce971519c73b49a30d2fa086bcb0b5
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:54.641700 7808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.630073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:46861 (local address 127.15.239.254:44087)
0810 04:53:54.630166 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.630170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.630465 (+ 295us) server_negotiation.cc:407] Connection header received
0810 04:53:54.631310 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.631311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.631322 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.631395 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:54.633041 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.633670 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.634813 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.635152 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.635233 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.638222 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:54.638223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:54.638224 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:54.638232 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:54.639831 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.640433 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.640434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.640434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.640510 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.640862 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.640864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.640864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.641017 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:54.641079 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.641525 (+ 446us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.641613 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:53:54.642045 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.630036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:46861)
0810 04:53:54.630279 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:54.630355 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:54.631175 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:54.631495 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:54.631502 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:54.632574 (+ 1072us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:54.632930 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.632938 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.633793 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.633794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.634724 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.634726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.635247 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.635248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.635363 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.636011 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:54.636065 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:54.638104 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:54.639924 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:54.639935 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:54.639937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:54.640326 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:54.640588 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:54.640589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:54.640590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:54.640756 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:54.641094 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:54.641102 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:54.641310 (+ 208us) client_negotiation.cc:769] Sending connection context
0810 04:53:54.641450 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 04:53:54.641663 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":123,"threads_started":1}
I20260810 04:53:54.642730 8226 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44087
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
I20260810 04:53:54.642853 8226 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:54.643131 8226 heartbeater.cc:511] Master 127.15.239.254:44087 requested a full tablet report, sending...
I20260810 04:53:54.643622 7752 ts_manager.cc:194] Registered new tserver with Master: 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825)
I20260810 04:53:54.644121 7752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:46861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:53:54.664196 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44087
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:53:54.760121 8233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:53:54.760397 8233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:53:54.760425 8233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:53:54.761730 8233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:53:54.761778 8233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:53:54.761806 8233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:53:54.763417 8233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:53:54.763746 8233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:53:54.764057 8233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:53:54.769936 8245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.769929 8244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:53:54.769938 8250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:53:54.770450 8233 server_base.cc:1034] running on GCE node
I20260810 04:53:54.770730 8233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:53:54.771035 8233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:53:54.772194 8233 hybrid_clock.cc:648] HybridClock initialized: now 1786337634772157 us; error 53 us; skew 500 ppm
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:53:54.775295 8233 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:53:54.775839 8233 webserver.cc:460] Webserver started at http://127.15.239.195:42497/ using document root <none> and password file <none>
I20260810 04:53:54.776131 8233 fs_manager.cc:359] Metadata directory not provided
I20260810 04:53:54.776185 8233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:53:54.776297 8233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:53:54.777488 8233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "32c5eb92d341469da51ad759e2be1a5a"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "3ef8a035cdbd8e589cd2db1e89b84916"
server_key_iv: "875db2846e7611c13d672e9eeb589065"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.777845 8233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "32c5eb92d341469da51ad759e2be1a5a"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "3ef8a035cdbd8e589cd2db1e89b84916"
server_key_iv: "875db2846e7611c13d672e9eeb589065"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.779405 8233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:53:54.780375 8263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.780584 8233 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:53:54.780709 8233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "32c5eb92d341469da51ad759e2be1a5a"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "3ef8a035cdbd8e589cd2db1e89b84916"
server_key_iv: "875db2846e7611c13d672e9eeb589065"
server_key_version: "encryptionkey@0"
I20260810 04:53:54.780797 8233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:53:54.795657 8233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:53:54.798606 8233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:53:54.798806 8233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:53:54.799135 8233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:53:54.799540 8233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:53:54.799600 8233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.799654 8233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:53:54.799678 8233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:53:54.807073 8233 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:44325
I20260810 04:53:54.807138 8445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:44325 every 8 connection(s)
I20260810 04:53:54.807576 8233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:53:54.811053 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 8233
I20260810 04:53:54.811195 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:53:54.811383 16319 external_mini_cluster.cc:1428] Setting key 14d28a1fe797a472b6f8f134a392633c
Aug 10 04:53:54 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337634, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:53:54.818642 7808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.808607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:48265 (local address 127.15.239.254:44087)
0810 04:53:54.808711 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.808713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.808948 (+ 235us) server_negotiation.cc:407] Connection header received
0810 04:53:54.809687 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.809689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.809701 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.809768 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:54.810962 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.811702 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.813109 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.813304 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.813363 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.815680 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:54.815682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:54.815682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:54.815690 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:54.817272 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.817691 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.817692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.817693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.817749 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.818033 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.818034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.818034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.818151 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:54.818205 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.818485 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.818560 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 04:53:54.818925 8448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.808592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:48265)
0810 04:53:54.808789 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:54.808841 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:54.809585 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:54.809837 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:54.809841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:54.810542 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:53:54.810837 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.810846 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.811807 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.811809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.813035 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.813038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.813379 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.813392 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.813514 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.814042 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:53:54.814052 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:53:54.815588 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:53:54.817364 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:54.817370 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:54.817372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:54.817621 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:54.817831 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:53:54.817832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:53:54.817832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:53:54.817958 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:53:54.818209 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:53:54.818215 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:53:54.818362 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 04:53:54.818458 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:53:54.818606 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260810 04:53:54.819564 8446 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44087
I20260810 04:53:54.819720 8446 heartbeater.cc:464] Registering TS with master...
I20260810 04:53:54.819954 8446 heartbeater.cc:511] Master 127.15.239.254:44087 requested a full tablet report, sending...
I20260810 04:53:54.820502 7752 ts_manager.cc:194] Registered new tserver with Master: 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325)
I20260810 04:53:54.820930 7752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:48265
I20260810 04:53:54.823482 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:53:54.832499 7808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.825185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50030 (local address 127.15.239.254:44087)
0810 04:53:54.825273 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.825276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.825377 (+ 101us) server_negotiation.cc:407] Connection header received
0810 04:53:54.825416 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.825417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.825427 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.825477 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:53:54.826093 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.826625 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.827438 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.827652 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.827716 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.829303 (+ 1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:53:54.829304 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:53:54.829305 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:53:54.829314 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:53:54.830966 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.831398 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.831400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.831401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.831479 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:53:54.831707 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:53:54.831708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:53:54.831709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:53:54.831937 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:53:54.832109 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.832284 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.832367 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 04:53:54.834543 7752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:53:54.836769 7752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:53:54.844444 8460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.839777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:34825 (local address 127.0.0.1:33566)
0810 04:53:54.840239 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:54.840248 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:54.840296 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:54.840726 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:54.840730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:54.840733 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:54.840838 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.840841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.841894 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.841895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.843227 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.843230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.844064 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.844065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.844156 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.844171 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 04:53:54.844252 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 04:53:54.844321 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":1,"thread_start_us":141,"threads_started":1}
I20260810 04:53:54.844542 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.840256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35752 (local address 127.15.239.193:33881)
0810 04:53:54.840533 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.840538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.840735 (+ 197us) server_negotiation.cc:407] Connection header received
0810 04:53:54.840783 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.840786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.840803 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.840902 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:54.841025 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.842159 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.843325 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.844156 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.844243 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.844297 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.844386 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.844428 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":134,"threads_started":1}
I20260810 04:53:54.844456 8465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.840080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:33881 (local address 127.0.0.1:35752)
0810 04:53:54.840594 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:54.840605 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:54.840672 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:54.840907 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:54.840908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:54.840910 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:54.840960 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.840962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.842289 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.842290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.843222 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.843225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.844247 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.844248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.844303 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.844307 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:53:54.844360 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 04:53:54.844398 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":112,"threads_started":1}
I20260810 04:53:54.844960 8464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.839925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36238 (local address 127.15.239.195:44325)
0810 04:53:54.840546 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.840551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.840563 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:53:54.840616 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.840621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.840641 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.840734 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:54.840990 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.842157 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.843437 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.844165 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.844243 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.844297 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.844796 (+ 499us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.844847 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":170,"threads_started":1}
I20260810 04:53:54.844724 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.839776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44325 (local address 127.0.0.1:36238)
0810 04:53:54.840001 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:54.840093 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:54.840179 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:54.840834 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:54.840835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:54.840837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:54.840906 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.840908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.842276 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.842277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.843343 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:54.843346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.844485 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.844485 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:54.844549 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.844552 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:53:54.844607 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 04:53:54.844655 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":78,"threads_started":1}
I20260810 04:53:54.845553 8468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:54.840249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33566 (local address 127.15.239.194:34825)
0810 04:53:54.840507 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:54.840514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:54.840526 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:53:54.840576 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:54.840579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:54.840598 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:54.840948 (+ 350us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:54.841041 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.841782 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.843335 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:54.843927 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:54.844026 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:54.844120 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:54.845367 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0810 04:53:54.845433 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":137,"threads_started":1}
I20260810 04:53:54.846302 8126 tablet_service.cc:1467] Processing CreateTablet for tablet bed200d8db8840f1b4ad3304890f1101 (DEFAULT_TABLE table=test-table [id=7e3d63c6bb0945cc8e0cd4827340082a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:54.846306 7931 tablet_service.cc:1467] Processing CreateTablet for tablet bed200d8db8840f1b4ad3304890f1101 (DEFAULT_TABLE table=test-table [id=7e3d63c6bb0945cc8e0cd4827340082a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:54.846306 8338 tablet_service.cc:1467] Processing CreateTablet for tablet bed200d8db8840f1b4ad3304890f1101 (DEFAULT_TABLE table=test-table [id=7e3d63c6bb0945cc8e0cd4827340082a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:53:54.846757 8126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed200d8db8840f1b4ad3304890f1101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:54.846758 8338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed200d8db8840f1b4ad3304890f1101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:54.846758 7931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed200d8db8840f1b4ad3304890f1101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:53:54.850258 8469 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Bootstrap starting.
I20260810 04:53:54.851047 8472 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Bootstrap starting.
I20260810 04:53:54.851153 8471 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Bootstrap starting.
I20260810 04:53:54.851280 8469 tablet_bootstrap.cc:654] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:54.851882 8472 tablet_bootstrap.cc:654] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:54.851882 8471 tablet_bootstrap.cc:654] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Neither blocks nor log segments found. Creating new log.
I20260810 04:53:54.852065 8469 log.cc:824] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:54.852566 8472 log.cc:824] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:54.852622 8471 log.cc:824] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:53:54.853084 8469 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: No bootstrap required, opened a new log
I20260810 04:53:54.853178 8469 ts_tablet_manager.cc:1397] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:53:54.853410 8472 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: No bootstrap required, opened a new log
I20260810 04:53:54.853426 8471 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: No bootstrap required, opened a new log
I20260810 04:53:54.853494 8472 ts_tablet_manager.cc:1397] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:53:54.853497 8471 ts_tablet_manager.cc:1397] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:53:54.854993 8472 raft_consensus.cc:348] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:54.855193 8472 raft_consensus.cc:374] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:54.855242 8472 raft_consensus.cc:729] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cb756688ead4133a0df910629835442, State: Initialized, Role: FOLLOWER
I20260810 04:53:54.855388 8472 consensus_queue.cc:260] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:54.855471 8469 raft_consensus.cc:348] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:54.855679 8469 raft_consensus.cc:374] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:54.855576 8471 raft_consensus.cc:348] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:54.855731 8471 raft_consensus.cc:374] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:53:54.855727 8469 raft_consensus.cc:729] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d4ef03acec448d9fe459608e4d7525, State: Initialized, Role: FOLLOWER
I20260810 04:53:54.855759 8472 ts_tablet_manager.cc:1428] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 04:53:54.855777 8471 raft_consensus.cc:729] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c5eb92d341469da51ad759e2be1a5a, State: Initialized, Role: FOLLOWER
I20260810 04:53:54.855890 8469 consensus_queue.cc:260] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:54.855888 8471 consensus_queue.cc:260] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:54.856226 8471 ts_tablet_manager.cc:1428] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 04:53:54.856232 8446 heartbeater.cc:503] Master 127.15.239.254:44087 was elected leader, sending a full tablet report...
I20260810 04:53:54.856460 8469 ts_tablet_manager.cc:1428] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:53:54.856539 8023 heartbeater.cc:503] Master 127.15.239.254:44087 was elected leader, sending a full tablet report...
I20260810 04:53:54.856631 8226 heartbeater.cc:503] Master 127.15.239.254:44087 was elected leader, sending a full tablet report...
W20260810 04:53:54.879796 8227 tablet.cc:2369] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:53:54.930627 8026 tablet.cc:2369] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:53:55.058368 8447 tablet.cc:2369] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:53:55.089149 8478 raft_consensus.cc:482] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:53:55.089334 8478 raft_consensus.cc:504] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:55.089944 8478 leader_election.cc:288] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825), 5cb756688ead4133a0df910629835442 (127.15.239.193:33881)
I20260810 04:53:55.094305 8468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:55.090300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:44277 (local address 127.15.239.194:34825)
0810 04:53:55.090377 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:55.090379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:55.090558 (+ 179us) server_negotiation.cc:407] Connection header received
0810 04:53:55.090604 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:55.090605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:55.090621 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:55.090668 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:55.090856 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.091586 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.093293 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.093905 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.093977 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:55.093989 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:55.094163 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:53:55.094220 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:53:55.094306 8448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:55.090175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:33881 (local address 127.15.239.195:34909)
0810 04:53:55.090246 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:55.090261 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:55.090320 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:55.090532 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:55.090534 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:55.090536 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:55.090632 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:55.090634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.091685 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.091686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:55.093180 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:55.093185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.093988 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.093989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:55.094076 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:55.094078 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:53:55.094138 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:53:55.094199 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":114}
I20260810 04:53:55.094305 8467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:55.090268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:34909 (local address 127.15.239.193:33881)
0810 04:53:55.090352 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:55.090354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:55.090366 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:53:55.090411 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:55.090412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:55.090428 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:55.090492 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:53:55.090753 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.091587 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.093293 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.093889 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.093977 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:55.093989 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:55.094162 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 04:53:55.094217 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:53:55.094318 8482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:55.090197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:34825 (local address 127.15.239.195:44277)
0810 04:53:55.090447 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:55.090455 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:53:55.090532 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:53:55.090699 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:53:55.090700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:53:55.090703 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:53:55.090778 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:55.090779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.091685 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.091686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:55.093180 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:53:55.093185 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.093988 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.093989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:53:55.094071 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:55.094076 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:53:55.094138 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:53:55.094199 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":91,"thread_start_us":158,"threads_started":1}
I20260810 04:53:55.094849 7960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed200d8db8840f1b4ad3304890f1101" candidate_uuid: "32c5eb92d341469da51ad759e2be1a5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cb756688ead4133a0df910629835442" is_pre_election: true
I20260810 04:53:55.094848 8156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed200d8db8840f1b4ad3304890f1101" candidate_uuid: "32c5eb92d341469da51ad759e2be1a5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d4ef03acec448d9fe459608e4d7525" is_pre_election: true
I20260810 04:53:55.095067 7960 raft_consensus.cc:2454] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c5eb92d341469da51ad759e2be1a5a in term 0.
I20260810 04:53:55.095070 8156 raft_consensus.cc:2454] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32c5eb92d341469da51ad759e2be1a5a in term 0.
I20260810 04:53:55.095383 8269 leader_election.cc:302] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c5eb92d341469da51ad759e2be1a5a, 5cb756688ead4133a0df910629835442; no voters:
I20260810 04:53:55.095633 8478 raft_consensus.cc:2781] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:53:55.095680 8478 raft_consensus.cc:482] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:53:55.095700 8478 raft_consensus.cc:3037] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:55.096827 8478 raft_consensus.cc:504] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:55.097002 8478 leader_election.cc:288] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [CANDIDATE]: Term 1 election: Requested vote from peers 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825), 5cb756688ead4133a0df910629835442 (127.15.239.193:33881)
I20260810 04:53:55.097250 7960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed200d8db8840f1b4ad3304890f1101" candidate_uuid: "32c5eb92d341469da51ad759e2be1a5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cb756688ead4133a0df910629835442"
I20260810 04:53:55.097240 8156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed200d8db8840f1b4ad3304890f1101" candidate_uuid: "32c5eb92d341469da51ad759e2be1a5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d4ef03acec448d9fe459608e4d7525"
I20260810 04:53:55.097347 7960 raft_consensus.cc:3037] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:55.097347 8156 raft_consensus.cc:3037] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:53:55.098439 7960 raft_consensus.cc:2454] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c5eb92d341469da51ad759e2be1a5a in term 1.
I20260810 04:53:55.098448 8156 raft_consensus.cc:2454] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32c5eb92d341469da51ad759e2be1a5a in term 1.
I20260810 04:53:55.098644 8269 leader_election.cc:302] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c5eb92d341469da51ad759e2be1a5a, 5cb756688ead4133a0df910629835442; no voters:
I20260810 04:53:55.098758 8478 raft_consensus.cc:2781] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:53:55.098986 8478 raft_consensus.cc:686] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 1 LEADER]: Becoming Leader. State: Replica: 32c5eb92d341469da51ad759e2be1a5a, State: Running, Role: LEADER
I20260810 04:53:55.099128 8478 consensus_queue.cc:237] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:53:55.100296 7750 catalog_manager.cc:5495] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195). New cstate: current_term: 1 leader_uuid: "32c5eb92d341469da51ad759e2be1a5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } health_report { overall_health: UNKNOWN } } }
I20260810 04:53:55.130059 8464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:55.127279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36244 (local address 127.15.239.195:44325)
0810 04:53:55.127367 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 04:53:55.127369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:53:55.127379 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:53:55.127427 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:53:55.127428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:53:55.127452 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:53:55.127548 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:53:55.127743 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.128328 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.129188 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:53:55.129420 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:53:55.129486 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:53:55.129685 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:53:55.129825 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:53:55.129903 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:53:55.129951 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 04:53:55.129975 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 04:53:55.132727 7960 raft_consensus.cc:1261] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Refusing update from remote peer 32c5eb92d341469da51ad759e2be1a5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:55.132727 8156 raft_consensus.cc:1261] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Refusing update from remote peer 32c5eb92d341469da51ad759e2be1a5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:53:55.133270 8483 consensus_queue.cc:1035] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:55.133445 8478 consensus_queue.cc:1035] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:53:55.136251 8486 mvcc.cc:205] Tried to move back new op lower bound from 7316838953499656192 to 7316838953366818816. Current Snapshot: MvccSnapshot[applied={T|T < 7316838953499656192}]
I20260810 04:53:55.137270 8487 mvcc.cc:205] Tried to move back new op lower bound from 7316838953499656192 to 7316838953366818816. Current Snapshot: MvccSnapshot[applied={T|T < 7316838953499656192}]
I20260810 04:53:55.138918 7748 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:55.139035 7748 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:53:55.140048 7748 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Sending DeleteTablet for 3 replicas of tablet bed200d8db8840f1b4ad3304890f1101
I20260810 04:53:55.140460 8338 tablet_service.cc:1514] Processing DeleteTablet for tablet bed200d8db8840f1b4ad3304890f1101 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:55 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:36238
I20260810 04:53:55.140506 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 7843
I20260810 04:53:55.140710 7931 tablet_service.cc:1514] Processing DeleteTablet for tablet bed200d8db8840f1b4ad3304890f1101 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:55 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:35752
I20260810 04:53:55.141270 8126 tablet_service.cc:1514] Processing DeleteTablet for tablet bed200d8db8840f1b4ad3304890f1101 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:55 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:33566
I20260810 04:53:55.146389 8503 tablet_replica.cc:330] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: stopping tablet replica
I20260810 04:53:55.146543 8503 raft_consensus.cc:2229] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:53:55.146677 8503 raft_consensus.cc:2258] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:55.147871 8502 tablet_replica.cc:330] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: stopping tablet replica
I20260810 04:53:55.147990 8502 raft_consensus.cc:2229] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:53:55.148121 8502 raft_consensus.cc:2258] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:53:55.149448 8502 ts_tablet_manager.cc:1905] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:55.150348 8503 ts_tablet_manager.cc:1905] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:53:55.151418 8502 ts_tablet_manager.cc:1918] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:55.151501 8502 log.cc:1196] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/bed200d8db8840f1b4ad3304890f1101
I20260810 04:53:55.151809 8502 ts_tablet_manager.cc:1939] T bed200d8db8840f1b4ad3304890f1101 P 32c5eb92d341469da51ad759e2be1a5a: Deleting consensus metadata
I20260810 04:53:55.152275 8503 ts_tablet_manager.cc:1918] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:53:55.152364 8503 log.cc:1196] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/bed200d8db8840f1b4ad3304890f1101
I20260810 04:53:55.152418 7734 catalog_manager.cc:4841] TS 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325): tablet bed200d8db8840f1b4ad3304890f1101 (table test-table [id=7e3d63c6bb0945cc8e0cd4827340082a]) successfully deleted
I20260810 04:53:55.152631 8503 ts_tablet_manager.cc:1939] T bed200d8db8840f1b4ad3304890f1101 P 39d4ef03acec448d9fe459608e4d7525: Deleting consensus metadata
I20260810 04:53:55.153033 7735 catalog_manager.cc:4841] TS 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825): tablet bed200d8db8840f1b4ad3304890f1101 (table test-table [id=7e3d63c6bb0945cc8e0cd4827340082a]) successfully deleted
W20260810 04:53:55.164554 7734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:33881 (error 108)
I20260810 04:53:55.164737 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 8032
I20260810 04:53:55.171211 8462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:53:55.170985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:33881 (local address 127.0.0.1:35762)
0810 04:53:55.171058 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:53:55.171139 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:33881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:53:55.172386 7734 catalog_manager.cc:4584] TS 5cb756688ead4133a0df910629835442 (127.15.239.193:33881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bed200d8db8840f1b4ad3304890f1101: Network error: Client connection negotiation failed: client connection to 127.15.239.193:33881: connect: Connection refused (error 111)
I20260810 04:53:55.180982 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 8233
I20260810 04:53:55.196460 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 7710
I20260810 04:54:15.212598 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44087
--webserver_interface=127.15.239.254
--webserver_port=38489
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:44087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:15.318372 8508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:15.318684 8508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:15.318714 8508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:15.320205 8508 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 04:54:15.320273 8508 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 04:54:15.320288 8508 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 04:54:15.320302 8508 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:54:15.320317 8508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:15.320333 8508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:15.320346 8508 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:54:15.320360 8508 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:54:15.322355 8508 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:44087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=38489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:15.322683 8508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:15.322984 8508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:15.337387 8528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.337373 8525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.337373 8524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:15.337535 8508 server_base.cc:1034] running on GCE node
I20260810 04:54:15.338266 8508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:15.338724 8508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:15.339958 8508 hybrid_clock.cc:648] HybridClock initialized: now 1786337655339941 us; error 59 us; skew 500 ppm
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:15.349521 8508 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:54:15.350209 8508 webserver.cc:460] Webserver started at http://127.15.239.254:38489/ using document root <none> and password file <none>
I20260810 04:54:15.350534 8508 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:15.350612 8508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:15.352438 8508 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:54:15.353225 8538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.353438 8508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.353561 8508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "9310f264ca9641378078bc6eaaef1fbe"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "956d2211cf297e7d258c9bed84d1c1e0"
server_key_iv: "46ed91fb321cda9fd71ecfaa2d1d34f1"
server_key_version: "encryptionkey@0"
I20260810 04:54:15.354146 8508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:15.368386 8508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:15.370893 8508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:15.371093 8508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:15.376524 8508 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:44087
I20260810 04:54:15.376555 8613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:44087 every 8 connection(s)
I20260810 04:54:15.377099 8508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:54:15.379195 8616 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:54:15.380123 8616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap starting.
I20260810 04:54:15.381712 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 8508
I20260810 04:54:15.382098 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:33881
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:44087
--webserver_port=41583
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:54:15.392973 8616 log.cc:824] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:15.395898 8616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:54:15.396421 8616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap complete.
I20260810 04:54:15.399317 8616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:15.399659 8616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9310f264ca9641378078bc6eaaef1fbe, State: Initialized, Role: FOLLOWER
I20260810 04:54:15.399893 8616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:15.399988 8616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:54:15.400099 8616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:54:15.400180 8616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:54:15.401580 8616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:15.401728 8616 leader_election.cc:302] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9310f264ca9641378078bc6eaaef1fbe; no voters:
I20260810 04:54:15.402004 8616 leader_election.cc:288] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 04:54:15.402056 8620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:54:15.402210 8620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 LEADER]: Becoming Leader. State: Replica: 9310f264ca9641378078bc6eaaef1fbe, State: Running, Role: LEADER
I20260810 04:54:15.402392 8616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:54:15.402424 8620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:15.402930 8622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9310f264ca9641378078bc6eaaef1fbe. Latest consensus state: current_term: 2 leader_uuid: "9310f264ca9641378078bc6eaaef1fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } } }
I20260810 04:54:15.402925 8621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9310f264ca9641378078bc6eaaef1fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } } }
I20260810 04:54:15.403076 8622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:15.403112 8621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:15.403648 8634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:54:15.404834 8634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:54:15.405021 8634 catalog_manager.cc:1259] Loaded cluster ID: 490035d66322481a878350ffbbd28dad
I20260810 04:54:15.405303 8634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:54:15.406235 8634 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:54:15.406469 8634 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Loaded TSK: 0
I20260810 04:54:15.413435 8634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Generated new TSK 1
I20260810 04:54:15.413576 8634 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:54:15.502399 8618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:15.502691 8618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:15.502736 8618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:15.504544 8618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:15.504621 8618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:15.504673 8618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:54:15.506835 8618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:33881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=41583
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:15.507237 8618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:15.507593 8618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:15.514895 8659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.514928 8666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.514984 8661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:15.515604 8618 server_base.cc:1034] running on GCE node
I20260810 04:54:15.515853 8618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:15.516265 8618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:15.517506 8618 hybrid_clock.cc:648] HybridClock initialized: now 1786337655517475 us; error 50 us; skew 500 ppm
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:15.520596 8618 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:54:15.521188 8618 webserver.cc:460] Webserver started at http://127.15.239.193:41583/ using document root <none> and password file <none>
I20260810 04:54:15.521502 8618 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:15.521585 8618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:15.523262 8618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.524150 8674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.524333 8618 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.524493 8618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "5cb756688ead4133a0df910629835442"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "7ad8ef490011f546d7b7298ae0172848"
server_key_iv: "85e32247855bfc5e9b6166193fb8ac28"
server_key_version: "encryptionkey@0"
I20260810 04:54:15.524950 8618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:15.538919 8618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:15.541790 8618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:15.541986 8618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:15.542351 8618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:15.542969 8683 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:54:15.544912 8618 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:54:15.544986 8618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 04:54:15.545039 8618 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:54:15.546228 8618 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:54:15.546277 8618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.548250 8683 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Bootstrap starting.
I20260810 04:54:15.556758 8618 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:33881
I20260810 04:54:15.556895 8871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:33881 every 8 connection(s)
I20260810 04:54:15.557399 8618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:54:15.562525 8683 log.cc:824] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:15.562716 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 8618
I20260810 04:54:15.563062 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:34825
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:44087
--webserver_port=45867
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:15.569522 8683 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:54:15.569983 8683 tablet_bootstrap.cc:492] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Bootstrap complete.
I20260810 04:54:15.571321 8683 ts_tablet_manager.cc:1397] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.008s
I20260810 04:54:15.572932 8683 raft_consensus.cc:348] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.573351 8683 raft_consensus.cc:729] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cb756688ead4133a0df910629835442, State: Initialized, Role: FOLLOWER
I20260810 04:54:15.573542 8683 consensus_queue.cc:260] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.573956 8683 ts_tablet_manager.cc:1428] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
I20260810 04:54:15.574216 8877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.558783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:42521 (local address 127.15.239.254:44087)
0810 04:54:15.559024 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.559035 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.559303 (+ 268us) server_negotiation.cc:407] Connection header received
0810 04:54:15.560459 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.560467 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.560537 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.560699 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:15.562004 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.563324 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.565034 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.565668 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.565789 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.569170 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:15.569176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:15.569177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:15.569192 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:15.571668 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.572315 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.572319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.572320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.572463 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.572807 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.572808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.572809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.573186 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:15.573286 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.573790 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.573979 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":112,"threads_started":1}
I20260810 04:54:15.574224 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.558446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:42521)
0810 04:54:15.559082 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:15.559148 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:15.560160 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:15.560791 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:15.560799 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:15.561374 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:15.561855 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.561864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.563482 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.563483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.564916 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.564920 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.565938 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.565939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.566099 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.566874 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:15.566886 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:15.569016 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:15.571781 (+ 2765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.571791 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.571794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.572199 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.572546 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.572547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.572548 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.572717 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.573273 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:15.573282 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:15.573495 (+ 213us) client_negotiation.cc:769] Sending connection context
0810 04:54:15.573631 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 04:54:15.573872 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":112,"threads_started":1}
I20260810 04:54:15.575011 8872 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44087
I20260810 04:54:15.575121 8872 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:15.575340 8872 heartbeater.cc:511] Master 127.15.239.254:44087 requested a full tablet report, sending...
I20260810 04:54:15.576212 8562 ts_manager.cc:194] Registered new tserver with Master: 5cb756688ead4133a0df910629835442 (127.15.239.193:33881)
I20260810 04:54:15.577477 8562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:42521
I20260810 04:54:15.578790 8872 heartbeater.cc:503] Master 127.15.239.254:44087 was elected leader, sending a full tablet report...
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.193@KRBTEST.COM
I20260810 04:54:15.585805 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.577075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.15.239.193:33881)
0810 04:54:15.577249 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.577254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.577443 (+ 189us) server_negotiation.cc:407] Connection header received
0810 04:54:15.577600 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.577603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.577625 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.577675 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:15.578329 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.579211 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.580068 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.580381 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.580463 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.582710 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:15.582720 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:15.582720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:15.582727 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:15.584412 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.584841 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.584844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.584845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.584910 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.585120 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.585121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.585122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.585289 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:15.585380 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.585577 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.585685 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260810 04:54:15.585814 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.576999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:33881 (local address 127.0.0.1:33612)
0810 04:54:15.577328 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:15.577374 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:15.577486 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:15.577775 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:15.577778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:15.578166 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:15.578231 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.578234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.579308 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.579309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.579952 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.579954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.580466 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.580467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.580560 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.581142 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:15.581147 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:15.582616 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:15.584521 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.584529 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.584531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.584755 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.584984 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.584985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.584986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.585056 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.585370 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:15.585377 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:15.585438 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 04:54:15.585537 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 04:54:15.585687 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":126,"threads_started":1}
I20260810 04:54:15.586288 8737 tablet_service.cc:1514] Processing DeleteTablet for tablet bed200d8db8840f1b4ad3304890f1101 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:53:55 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:33612
I20260810 04:54:15.587630 8885 tablet_replica.cc:330] stopping tablet replica
I20260810 04:54:15.587777 8885 raft_consensus.cc:2229] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:15.587888 8885 raft_consensus.cc:2258] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:15.588336 8885 ts_tablet_manager.cc:1905] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:15.590734 8885 ts_tablet_manager.cc:1918] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:15.590839 8885 log.cc:1196] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal/wals/bed200d8db8840f1b4ad3304890f1101
I20260810 04:54:15.591087 8885 ts_tablet_manager.cc:1939] T bed200d8db8840f1b4ad3304890f1101 P 5cb756688ead4133a0df910629835442: Deleting consensus metadata
I20260810 04:54:15.591678 8543 catalog_manager.cc:4841] TS 5cb756688ead4133a0df910629835442 (127.15.239.193:33881): tablet bed200d8db8840f1b4ad3304890f1101 (table test-table [id=7e3d63c6bb0945cc8e0cd4827340082a]) successfully deleted
W20260810 04:54:15.670717 8880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:15.670975 8880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:15.671000 8880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:15.672271 8880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:15.672314 8880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:15.672359 8880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:54:15.673918 8880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:34825
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=45867
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:15.674187 8880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:15.674455 8880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:15.680529 8893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.680518 8894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.680518 8896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:15.680781 8880 server_base.cc:1034] running on GCE node
I20260810 04:54:15.681063 8880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:15.681345 8880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:15.682512 8880 hybrid_clock.cc:648] HybridClock initialized: now 1786337655682500 us; error 43 us; skew 500 ppm
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:15.685640 8880 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:54:15.686209 8880 webserver.cc:460] Webserver started at http://127.15.239.194:45867/ using document root <none> and password file <none>
I20260810 04:54:15.686501 8880 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:15.686595 8880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:15.688236 8880 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:54:15.688922 8912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.689180 8880 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.689318 8880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "39d4ef03acec448d9fe459608e4d7525"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "51e4bd3f33ed11638927058aac969a9f"
server_key_iv: "543d61ef0799072184f3e3f80e821ca4"
server_key_version: "encryptionkey@0"
I20260810 04:54:15.689777 8880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:15.700160 8880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:15.703050 8880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:15.703234 8880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:15.703569 8880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:15.703963 8880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:15.704057 8880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.704113 8880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:15.704144 8880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.711894 8880 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:34825
I20260810 04:54:15.711967 9085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:34825 every 8 connection(s)
I20260810 04:54:15.712459 8880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:54:15.715816 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 8880
I20260810 04:54:15.716235 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:44325
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:44087
--webserver_port=42497
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:15.724752 8877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.713385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:53385 (local address 127.15.239.254:44087)
0810 04:54:15.713488 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.713491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.713696 (+ 205us) server_negotiation.cc:407] Connection header received
0810 04:54:15.714287 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.714289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.714309 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.714376 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:15.715536 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.716513 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.717639 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.718011 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.718101 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.721098 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:15.721100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:15.721100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:15.721116 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:15.723029 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.723481 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.723482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.723483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.723562 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.723823 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.723824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.723825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.724055 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:15.724137 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.724465 (+ 328us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.724589 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 04:54:15.724959 9091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.713343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:53385)
0810 04:54:15.713554 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:15.713597 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:15.714188 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:15.714462 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:15.714466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:15.715145 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:15.715446 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.715451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.716619 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.716620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.717543 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.717546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.718121 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.718123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.718256 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.718992 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:15.719005 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:15.720955 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:15.723122 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.723131 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.723134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.723401 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.723637 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.723637 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.723637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.723754 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.724121 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:15.724128 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:15.724280 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 04:54:15.724387 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 04:54:15.724612 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":131,"threads_started":1}
I20260810 04:54:15.725626 9088 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44087
I20260810 04:54:15.725764 9088 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:15.726002 9088 heartbeater.cc:511] Master 127.15.239.254:44087 requested a full tablet report, sending...
I20260810 04:54:15.726567 8562 ts_manager.cc:194] Registered new tserver with Master: 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825)
I20260810 04:54:15.727037 8562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:53385
W20260810 04:54:15.813679 9092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:15.813980 9092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:15.814024 9092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:15.815303 9092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:15.815382 9092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:15.815428 9092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:54:15.817215 9092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:44325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=42497
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:15.817548 9092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:15.817840 9092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:15.823936 9098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:15.824124 9092 server_base.cc:1034] running on GCE node
W20260810 04:54:15.823939 9099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:15.823941 9104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:15.824559 9092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:15.824919 9092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:15.826130 9092 hybrid_clock.cc:648] HybridClock initialized: now 1786337655826113 us; error 28 us; skew 500 ppm
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:15.829603 9092 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:54:15.830176 9092 webserver.cc:460] Webserver started at http://127.15.239.195:42497/ using document root <none> and password file <none>
I20260810 04:54:15.830483 9092 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:15.830577 9092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:15.832314 9092 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 04:54:15.833012 9112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.833199 9092 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.833320 9092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "32c5eb92d341469da51ad759e2be1a5a"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "3ef8a035cdbd8e589cd2db1e89b84916"
server_key_iv: "875db2846e7611c13d672e9eeb589065"
server_key_version: "encryptionkey@0"
I20260810 04:54:15.833791 9092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:15.854503 9092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:15.857395 9092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:15.857630 9092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:15.857939 9092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:15.858356 9092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:15.858412 9092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.858462 9092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:15.858500 9092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:15.865695 9092 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:44325
I20260810 04:54:15.865790 9279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:44325 every 8 connection(s)
I20260810 04:54:15.866250 9092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:54:15 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337655, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:15.874969 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 9092
I20260810 04:54:15.877993 8877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.867222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:37101 (local address 127.15.239.254:44087)
0810 04:54:15.867320 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.867322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.867613 (+ 291us) server_negotiation.cc:407] Connection header received
0810 04:54:15.868300 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.868302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.868319 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.868390 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:15.869537 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.870097 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.871233 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.871453 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.871541 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.874294 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:15.874296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:15.874296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:15.874304 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:15.876365 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.876914 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.876915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.876916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.877001 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.877260 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.877261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.877262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.877422 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:15.877503 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.877815 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.877906 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 04:54:15.878279 9283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.867203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:37101)
0810 04:54:15.867444 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:15.867507 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:15.868178 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:15.868477 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:15.868487 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:15.869178 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:15.869431 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.869436 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.870194 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.870196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.871138 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.871141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.871551 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.871552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.871711 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.872369 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:15.872381 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:15.874181 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:15.876473 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.876482 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.876485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.876840 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.877078 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:15.877079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:15.877079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:15.877195 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:15.877491 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:15.877496 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:15.877644 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 04:54:15.877776 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 04:54:15.877990 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":109,"threads_started":1}
I20260810 04:54:15.878870 9280 heartbeater.cc:347] Connected to a master server at 127.15.239.254:44087
I20260810 04:54:15.879024 9280 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:15.879316 9280 heartbeater.cc:511] Master 127.15.239.254:44087 requested a full tablet report, sending...
I20260810 04:54:15.880065 8562 ts_manager.cc:194] Registered new tserver with Master: 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325)
I20260810 04:54:15.880524 8562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:37101
I20260810 04:54:15.883569 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.875566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53670 (local address 127.15.239.254:44087)
0810 04:54:15.875742 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.875744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.875819 (+ 75us) server_negotiation.cc:407] Connection header received
0810 04:54:15.875870 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.875872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.875889 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.875992 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:15.876797 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.877653 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.878753 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.879005 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.879087 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.880737 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:15.880739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:15.880739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:15.880748 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:15.882256 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.882650 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.882651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.882651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.882720 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.882942 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.882943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.882944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.883075 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:15.883314 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.883355 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.883447 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260810 04:54:15.884531 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:54:15.887874 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.884922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53684 (local address 127.15.239.254:44087)
0810 04:54:15.884974 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.884976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.885127 (+ 151us) server_negotiation.cc:407] Connection header received
0810 04:54:15.885225 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.885227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.885285 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.885358 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:54:15.885506 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.886030 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.886862 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.887092 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.887174 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.887380 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:54:15.887447 (+ 67us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 04:54:15.887807 (+ 360us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53684: token expired
Metrics: {"server-negotiator.queue_time_us":29}
W20260810 04:54:15.887945 9287 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53684: token expired
W20260810 04:54:15.888074 8451 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.239.254:44087)
I20260810 04:54:15.894976 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.888438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53700 (local address 127.15.239.254:44087)
0810 04:54:15.888495 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.888496 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.888505 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:54:15.888530 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.888531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.888539 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.888587 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:15.889108 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.889566 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.890406 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.890587 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.890637 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.891915 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:15.891916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:15.891917 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:15.891923 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:15.893757 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.894220 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.894221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.894221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.894281 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:15.894496 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:15.894497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:15.894497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:15.894612 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:15.894699 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.894784 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.894853 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:54:15.896600 8562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:54:15.898738 8562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:54:15.901691 8737 tablet_service.cc:1467] Processing CreateTablet for tablet 9c66cad0337f4d518d93029d87948f46 (DEFAULT_TABLE table=test-table [id=07ca818427a84485946dd3ab95a7bad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:15.902007 8737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c66cad0337f4d518d93029d87948f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:15.903939 8683 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Bootstrap starting.
I20260810 04:54:15.904486 8683 tablet_bootstrap.cc:654] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:15.905158 8683 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: No bootstrap required, opened a new log
I20260810 04:54:15.905220 8683 ts_tablet_manager.cc:1397] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:15.905646 8683 raft_consensus.cc:348] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.905738 8683 raft_consensus.cc:374] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:15.905793 8683 raft_consensus.cc:729] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cb756688ead4133a0df910629835442, State: Initialized, Role: FOLLOWER
I20260810 04:54:15.905840 8683 consensus_queue.cc:260] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.905936 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.901096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:34825 (local address 127.0.0.1:34850)
0810 04:54:15.901152 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:15.901165 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:15.901228 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:15.901720 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:15.901721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:15.901723 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:15.901800 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.901802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.902979 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.902980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.904065 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.904069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.905606 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.905607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.905687 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.905715 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 04:54:15.905770 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 04:54:15.905842 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 04:54:15.905951 8683 ts_tablet_manager.cc:1428] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 04:54:15.906222 9294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.901309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34850 (local address 127.15.239.194:34825)
0810 04:54:15.901524 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.901531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.901544 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:54:15.901603 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.901605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.901624 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.901723 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:15.901854 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.902868 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.904347 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.905516 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.905613 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.905685 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.906044 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.906100 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":121,"threads_started":1}
I20260810 04:54:15.907178 8987 tablet_service.cc:1467] Processing CreateTablet for tablet 9c66cad0337f4d518d93029d87948f46 (DEFAULT_TABLE table=test-table [id=07ca818427a84485946dd3ab95a7bad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:15.907625 8987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c66cad0337f4d518d93029d87948f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:15.908274 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.901151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44325 (local address 127.0.0.1:59866)
0810 04:54:15.901550 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:15.901562 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:15.901620 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:15.904647 (+ 3027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:15.904648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:15.904651 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:15.904695 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.904697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.906004 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.906005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.907113 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:15.907116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.907972 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.907973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:15.908071 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.908077 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:54:15.908139 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 04:54:15.908192 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":110,"threads_started":1}
I20260810 04:54:15.908300 9297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:15.904009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59866 (local address 127.15.239.195:44325)
0810 04:54:15.904251 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:15.904256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:15.904270 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:54:15.904393 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:15.904396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:15.904419 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:15.904515 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:15.904779 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.905897 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.907209 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:15.907869 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:15.907973 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:15.908068 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:15.908156 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:54:15.908207 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":126,"threads_started":1}
I20260810 04:54:15.908969 9187 tablet_service.cc:1467] Processing CreateTablet for tablet 9c66cad0337f4d518d93029d87948f46 (DEFAULT_TABLE table=test-table [id=07ca818427a84485946dd3ab95a7bad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:15.909335 9187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c66cad0337f4d518d93029d87948f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:15.914374 9299 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Bootstrap starting.
I20260810 04:54:15.915277 9299 tablet_bootstrap.cc:654] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:15.915985 9299 log.cc:824] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:15.916528 9301 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Bootstrap starting.
I20260810 04:54:15.917100 9299 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: No bootstrap required, opened a new log
I20260810 04:54:15.917274 9299 ts_tablet_manager.cc:1397] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:54:15.917484 9301 tablet_bootstrap.cc:654] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:15.918183 9301 log.cc:824] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:15.919170 9301 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: No bootstrap required, opened a new log
I20260810 04:54:15.919255 9301 ts_tablet_manager.cc:1397] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:54:15.919894 9299 raft_consensus.cc:348] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.920173 9299 raft_consensus.cc:374] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:15.920219 9299 raft_consensus.cc:729] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d4ef03acec448d9fe459608e4d7525, State: Initialized, Role: FOLLOWER
I20260810 04:54:15.920377 9299 consensus_queue.cc:260] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.920735 9299 ts_tablet_manager.cc:1428] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:54:15.921030 9088 heartbeater.cc:503] Master 127.15.239.254:44087 was elected leader, sending a full tablet report...
I20260810 04:54:15.921619 9301 raft_consensus.cc:348] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.921868 9301 raft_consensus.cc:374] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:15.921931 9301 raft_consensus.cc:729] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32c5eb92d341469da51ad759e2be1a5a, State: Initialized, Role: FOLLOWER
I20260810 04:54:15.922061 9301 consensus_queue.cc:260] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:15.922456 9301 ts_tablet_manager.cc:1428] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 04:54:15.922466 9280 heartbeater.cc:503] Master 127.15.239.254:44087 was elected leader, sending a full tablet report...
W20260810 04:54:15.963231 9089 tablet.cc:2369] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:54:16.058735 8873 tablet.cc:2369] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:54:16.117017 9281 tablet.cc:2369] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:54:16.253566 9304 raft_consensus.cc:482] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:16.253818 9304 raft_consensus.cc:504] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:16.254315 9304 leader_election.cc:288] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325), 5cb756688ead4133a0df910629835442 (127.15.239.193:33881)
I20260810 04:54:16.258919 9297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:16.254707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:44841 (local address 127.15.239.195:44325)
0810 04:54:16.254792 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:16.254795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:16.254859 (+ 64us) server_negotiation.cc:407] Connection header received
0810 04:54:16.254956 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:16.254958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:16.254972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:16.255070 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:16.255331 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.256178 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.257729 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.258327 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.258444 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:16.258458 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:16.258774 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 04:54:16.258827 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:54:16.258924 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:16.254897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:34315 (local address 127.15.239.193:33881)
0810 04:54:16.255229 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:16.255231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:16.255243 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:54:16.255301 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:16.255303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:16.255349 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:16.255458 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:16.255658 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.256384 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.257730 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.258464 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.258538 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:16.258616 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:16.258775 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 04:54:16.258836 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":160,"threads_started":1}
I20260810 04:54:16.258934 9308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:16.254586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44325 (local address 127.15.239.194:44841)
0810 04:54:16.254734 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:16.254749 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:16.254870 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:16.255115 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:16.255116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:16.255120 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:16.255226 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:16.255228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.256276 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.256277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:16.257622 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:16.257625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.258472 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.258473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:16.258613 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:16.258626 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:54:16.258713 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 04:54:16.258786 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":9,"thread_start_us":76,"threads_started":1}
I20260810 04:54:16.258934 9309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:16.254785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:33881 (local address 127.15.239.194:34315)
0810 04:54:16.254911 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:16.254923 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:16.254990 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:16.255493 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:16.255495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:16.255497 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:16.255570 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:16.255571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.256455 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.256456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:16.257622 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:16.257625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.258541 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.258541 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:16.258618 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:16.258623 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:16.258713 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 04:54:16.258786 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":19,"thread_start_us":72,"threads_started":1}
I20260810 04:54:16.259529 9216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c66cad0337f4d518d93029d87948f46" candidate_uuid: "39d4ef03acec448d9fe459608e4d7525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c5eb92d341469da51ad759e2be1a5a" is_pre_election: true
I20260810 04:54:16.259523 8786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c66cad0337f4d518d93029d87948f46" candidate_uuid: "39d4ef03acec448d9fe459608e4d7525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cb756688ead4133a0df910629835442" is_pre_election: true
I20260810 04:54:16.259737 8786 raft_consensus.cc:2454] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d4ef03acec448d9fe459608e4d7525 in term 0.
I20260810 04:54:16.259735 9216 raft_consensus.cc:2454] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d4ef03acec448d9fe459608e4d7525 in term 0.
I20260810 04:54:16.260015 8915 leader_election.cc:302] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32c5eb92d341469da51ad759e2be1a5a, 39d4ef03acec448d9fe459608e4d7525; no voters:
I20260810 04:54:16.260182 9304 raft_consensus.cc:2781] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:54:16.260249 9304 raft_consensus.cc:482] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:54:16.260277 9304 raft_consensus.cc:3037] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:16.261210 9304 raft_consensus.cc:504] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:16.261377 9304 leader_election.cc:288] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [CANDIDATE]: Term 1 election: Requested vote from peers 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325), 5cb756688ead4133a0df910629835442 (127.15.239.193:33881)
I20260810 04:54:16.261569 9216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c66cad0337f4d518d93029d87948f46" candidate_uuid: "39d4ef03acec448d9fe459608e4d7525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32c5eb92d341469da51ad759e2be1a5a"
I20260810 04:54:16.261571 8786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c66cad0337f4d518d93029d87948f46" candidate_uuid: "39d4ef03acec448d9fe459608e4d7525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cb756688ead4133a0df910629835442"
I20260810 04:54:16.261662 9216 raft_consensus.cc:3037] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:16.261680 8786 raft_consensus.cc:3037] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:16.262729 8786 raft_consensus.cc:2454] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d4ef03acec448d9fe459608e4d7525 in term 1.
I20260810 04:54:16.262918 9216 raft_consensus.cc:2454] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d4ef03acec448d9fe459608e4d7525 in term 1.
I20260810 04:54:16.262905 8915 leader_election.cc:302] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d4ef03acec448d9fe459608e4d7525, 5cb756688ead4133a0df910629835442; no voters:
I20260810 04:54:16.263064 9304 raft_consensus.cc:2781] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:16.263268 9304 raft_consensus.cc:686] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 1 LEADER]: Becoming Leader. State: Replica: 39d4ef03acec448d9fe459608e4d7525, State: Running, Role: LEADER
I20260810 04:54:16.263418 9304 consensus_queue.cc:237] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:16.264503 8562 catalog_manager.cc:5495] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194). New cstate: current_term: 1 leader_uuid: "39d4ef03acec448d9fe459608e4d7525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } health_report { overall_health: UNKNOWN } } }
I20260810 04:54:16.358031 9294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:16.355299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34862 (local address 127.15.239.194:34825)
0810 04:54:16.355373 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:16.355376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:16.355386 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:54:16.355475 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:16.355476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:16.355507 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:16.355570 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:54:16.355713 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.356274 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.357071 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:16.357268 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:16.357325 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:16.357621 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:54:16.357762 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:54:16.357851 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:16.357910 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 04:54:16.357934 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 04:54:16.360597 8786 raft_consensus.cc:1261] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Refusing update from remote peer 39d4ef03acec448d9fe459608e4d7525: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:16.360597 9216 raft_consensus.cc:1261] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Refusing update from remote peer 39d4ef03acec448d9fe459608e4d7525: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:16.361121 9304 consensus_queue.cc:1035] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:16.361313 9311 consensus_queue.cc:1035] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:16.364674 9316 mvcc.cc:205] Tried to move back new op lower bound from 7316839040448970752 to 7316839040055803904. Current Snapshot: MvccSnapshot[applied={T|T < 7316839040448970752}]
I20260810 04:54:16.366837 8562 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:16.366972 8562 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:16.366597 9320 mvcc.cc:205] Tried to move back new op lower bound from 7316839040448970752 to 7316839040055803904. Current Snapshot: MvccSnapshot[applied={T|T < 7316839040448970752 or (T in {7316839040448970752})}]
I20260810 04:54:16.367940 8562 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Sending DeleteTablet for 3 replicas of tablet 9c66cad0337f4d518d93029d87948f46
I20260810 04:54:16.368434 8987 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c66cad0337f4d518d93029d87948f46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:16 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:34850
I20260810 04:54:16.368465 8737 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c66cad0337f4d518d93029d87948f46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:16 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:33612
I20260810 04:54:16.368584 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 8618
I20260810 04:54:16.368736 9331 tablet_replica.cc:330] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: stopping tablet replica
I20260810 04:54:16.368853 9331 raft_consensus.cc:2229] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:54:16.368973 9331 raft_consensus.cc:2258] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:16.386919 9331 ts_tablet_manager.cc:1905] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:16.387789 9187 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c66cad0337f4d518d93029d87948f46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:16 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59866
I20260810 04:54:16.389024 9333 tablet_replica.cc:330] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: stopping tablet replica
I20260810 04:54:16.389179 9331 ts_tablet_manager.cc:1918] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:16.389257 9333 raft_consensus.cc:2229] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:16.389329 9331 log.cc:1196] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/9c66cad0337f4d518d93029d87948f46
I20260810 04:54:16.389578 9333 raft_consensus.cc:2258] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:16.389739 9331 ts_tablet_manager.cc:1939] T 9c66cad0337f4d518d93029d87948f46 P 39d4ef03acec448d9fe459608e4d7525: Deleting consensus metadata
I20260810 04:54:16.390316 9333 ts_tablet_manager.cc:1905] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:16.390390 8544 catalog_manager.cc:4841] TS 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825): tablet 9c66cad0337f4d518d93029d87948f46 (table test-table [id=07ca818427a84485946dd3ab95a7bad1]) successfully deleted
I20260810 04:54:16.391988 9333 ts_tablet_manager.cc:1918] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:16.392113 9333 log.cc:1196] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/9c66cad0337f4d518d93029d87948f46
I20260810 04:54:16.392526 9333 ts_tablet_manager.cc:1939] T 9c66cad0337f4d518d93029d87948f46 P 32c5eb92d341469da51ad759e2be1a5a: Deleting consensus metadata
I20260810 04:54:16.393353 8543 catalog_manager.cc:4841] TS 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325): tablet 9c66cad0337f4d518d93029d87948f46 (table test-table [id=07ca818427a84485946dd3ab95a7bad1]) successfully deleted
W20260810 04:54:16.397540 8543 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:33881 (error 108)
I20260810 04:54:16.398052 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 8880
I20260810 04:54:16.405527 9293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:16.398269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:33881 (local address 127.0.0.1:33628)
0810 04:54:16.405335 (+ 7066us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:16.405451 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:33881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7019}
W20260810 04:54:16.412781 8543 catalog_manager.cc:4584] TS 5cb756688ead4133a0df910629835442 (127.15.239.193:33881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c66cad0337f4d518d93029d87948f46: Network error: Client connection negotiation failed: client connection to 127.15.239.193:33881: connect: Connection refused (error 111)
I20260810 04:54:16.419704 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 9092
I20260810 04:54:16.436714 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 8508
I20260810 04:54:36.451193 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44087
--webserver_interface=127.15.239.254
--webserver_port=38489
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:44087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:36.551146 9337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:36.551467 9337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:36.551507 9337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:36.552882 9337 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 04:54:36.552961 9337 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 04:54:36.552994 9337 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 04:54:36.553012 9337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:54:36.553045 9337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:36.553069 9337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:36.553100 9337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:54:36.553129 9337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:54:36.554826 9337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:44087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:44087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=38489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:36.555194 9337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:36.555497 9337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:36.562126 9344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:36.562153 9337 server_base.cc:1034] running on GCE node
W20260810 04:54:36.562120 9348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:36.562325 9343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:36.562713 9337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:36.563119 9337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:36.564325 9337 hybrid_clock.cc:648] HybridClock initialized: now 1786337676564300 us; error 64 us; skew 500 ppm
Aug 10 04:54:36 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:36.567516 9337 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:54:36.568114 9337 webserver.cc:460] Webserver started at http://127.15.239.254:38489/ using document root <none> and password file <none>
I20260810 04:54:36.568403 9337 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:36.568482 9337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:36.570202 9337 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:54:36.571134 9358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:36.571377 9337 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:54:36.571511 9337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "9310f264ca9641378078bc6eaaef1fbe"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "956d2211cf297e7d258c9bed84d1c1e0"
server_key_iv: "46ed91fb321cda9fd71ecfaa2d1d34f1"
server_key_version: "encryptionkey@0"
I20260810 04:54:36.572002 9337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:36.586118 9337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:36.588989 9337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:36.589183 9337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:36.594578 9337 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:44087
I20260810 04:54:36.594619 9432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:44087 every 8 connection(s)
I20260810 04:54:36.595101 9337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:54:36.597072 9435 sys_catalog.cc:263] Verifying existing consensus state
I20260810 04:54:36.597903 9435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap starting.
I20260810 04:54:36.600222 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 9337
I20260810 04:54:36.600564 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:33881
--local_ip_for_outbound_sockets=127.15.239.193
--tserver_master_addrs=127.15.239.254:44087
--webserver_port=41583
--webserver_interface=127.15.239.193
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:54:36.610188 9435 log.cc:824] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:36.613106 9435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:54:36.613492 9435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Bootstrap complete.
I20260810 04:54:36.616319 9435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:36.616628 9435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9310f264ca9641378078bc6eaaef1fbe, State: Initialized, Role: FOLLOWER
I20260810 04:54:36.616859 9435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:36.616933 9435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:54:36.617004 9435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:54:36.617054 9435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 2 FOLLOWER]: Advancing to term 3
I20260810 04:54:36.618312 9435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:36.618443 9435 leader_election.cc:302] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9310f264ca9641378078bc6eaaef1fbe; no voters:
I20260810 04:54:36.618693 9435 leader_election.cc:288] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 04:54:36.618734 9441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 3 FOLLOWER]: Leader election won for term 3
I20260810 04:54:36.618927 9441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [term 3 LEADER]: Becoming Leader. State: Replica: 9310f264ca9641378078bc6eaaef1fbe, State: Running, Role: LEADER
I20260810 04:54:36.619045 9435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:54:36.619094 9441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } }
I20260810 04:54:36.619426 9441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9310f264ca9641378078bc6eaaef1fbe. Latest consensus state: current_term: 3 leader_uuid: "9310f264ca9641378078bc6eaaef1fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } } }
I20260810 04:54:36.619508 9441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:36.619431 9443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9310f264ca9641378078bc6eaaef1fbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9310f264ca9641378078bc6eaaef1fbe" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 44087 } } }
I20260810 04:54:36.619714 9443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:36.619844 9449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:54:36.621085 9449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:54:36.621255 9449 catalog_manager.cc:1259] Loaded cluster ID: 490035d66322481a878350ffbbd28dad
I20260810 04:54:36.621445 9449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:54:36.622668 9449 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:54:36.622882 9449 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Loaded TSK: 0
I20260810 04:54:36.622926 9449 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9310f264ca9641378078bc6eaaef1fbe: Loaded TSK: 1
F20260810 04:54:36.623179 9449 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6e1871f9ad google::LogMessage::Fail() at ??:0
@ 0x7f6e1872288a google::LogMessage::SendToLog() at ??:0
@ 0x7f6e1871f4de google::LogMessage::Flush() at ??:0
@ 0x7f6e18720a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6e1ae8c104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f6e1ae89d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f6e206791cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f6e2067948e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f6e20679594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f6e2063fc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f6e20649ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6e1a5ed0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6e1a5e2954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6e1b4466db start_thread at ??:0
@ 0x7f6e1721d61f clone at ??:0
W20260810 04:54:36.737339 9437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:36.737610 9437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:36.737639 9437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:36.738935 9437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:36.738991 9437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:36.739022 9437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:54:36.740746 9437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:33881
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=41583
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:36.741055 9437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:36.741364 9437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:36.747442 9511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:36.747567 9514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:36.747473 9512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:36.747937 9437 server_base.cc:1034] running on GCE node
I20260810 04:54:36.748219 9437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:36.748550 9437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:36.749739 9437 hybrid_clock.cc:648] HybridClock initialized: now 1786337676749710 us; error 42 us; skew 500 ppm
Aug 10 04:54:36 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:36.753465 9437 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:54:36.754029 9437 webserver.cc:460] Webserver started at http://127.15.239.193:41583/ using document root <none> and password file <none>
I20260810 04:54:36.754307 9437 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:36.754390 9437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:36.756085 9437 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 04:54:36.757030 9525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:36.757251 9437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:54:36.757377 9437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "5cb756688ead4133a0df910629835442"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "7ad8ef490011f546d7b7298ae0172848"
server_key_iv: "85e32247855bfc5e9b6166193fb8ac28"
server_key_version: "encryptionkey@0"
I20260810 04:54:36.757805 9437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:36.766892 9437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:36.769479 9437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:36.769661 9437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:36.769943 9437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:36.770496 9536 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 04:54:36.772943 9437 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 04:54:36.773036 9437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260810 04:54:36.773093 9437 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 04:54:36.773916 9437 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 04:54:36.773977 9437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 04:54:36.774076 9536 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Bootstrap starting.
I20260810 04:54:36.783382 9437 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:33881
I20260810 04:54:36.783946 9697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:33881 every 8 connection(s)
I20260810 04:54:36.783998 9437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:54:36.789767 9536 log.cc:824] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:36.790266 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 9437
I20260810 04:54:36.790632 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:34825
--local_ip_for_outbound_sockets=127.15.239.194
--tserver_master_addrs=127.15.239.254:44087
--webserver_port=45867
--webserver_interface=127.15.239.194
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:54:36.793543 9536 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 04:54:36.793901 9536 tablet_bootstrap.cc:492] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Bootstrap complete.
I20260810 04:54:36.794937 9536 ts_tablet_manager.cc:1397] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.000s
I20260810 04:54:36.796314 9536 raft_consensus.cc:348] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:36.796633 9536 raft_consensus.cc:729] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cb756688ead4133a0df910629835442, State: Initialized, Role: FOLLOWER
I20260810 04:54:36.796836 9536 consensus_queue.cc:260] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:36.797273 9536 ts_tablet_manager.cc:1428] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442: Time spent starting tablet: real 0.002s user 0.001s sys 0.004s
W20260810 04:54:36.892693 9702 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:54:36.785093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:54967)
0810 04:54:36.785373 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:36.785442 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:36.786019 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:36.892391 (+106372us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":121,"threads_started":1}
W20260810 04:54:36.893060 9699 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:44087 (0 consecutive failures): Network error: Failed to ping master at 127.15.239.254:44087: Client connection negotiation failed: client connection to 127.15.239.254:44087: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 04:54:36.893476 9702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:36.893330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:50881)
0810 04:54:36.893399 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:36.893452 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 04:54:36.893862 9702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:36.893762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:34405)
0810 04:54:36.893815 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:36.893839 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 04:54:36.893991 9699 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:54:36.905164 9704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:36.905431 9704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:36.905472 9704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:36.906706 9704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:36.906772 9704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:36.906818 9704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:54:36.908473 9704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:34825
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=45867
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:36.908764 9704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:36.909042 9704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:36.914906 9712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:36.914898 9710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:36.914950 9714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:36.915387 9704 server_base.cc:1034] running on GCE node
I20260810 04:54:36.915596 9704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:36.915830 9704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:36.916983 9704 hybrid_clock.cc:648] HybridClock initialized: now 1786337676916951 us; error 39 us; skew 500 ppm
Aug 10 04:54:36 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:36.919965 9704 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:54:36.920594 9704 webserver.cc:460] Webserver started at http://127.15.239.194:45867/ using document root <none> and password file <none>
I20260810 04:54:36.920866 9704 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:36.920938 9704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:36.922529 9704 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:54:36.923296 9726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:36.923514 9704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:36.923638 9704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "39d4ef03acec448d9fe459608e4d7525"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "51e4bd3f33ed11638927058aac969a9f"
server_key_iv: "543d61ef0799072184f3e3f80e821ca4"
server_key_version: "encryptionkey@0"
I20260810 04:54:36.924165 9704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:36.937047 9704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:36.939594 9704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:36.939795 9704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:36.940147 9704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:36.940541 9704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:36.940600 9704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:36.940651 9704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:36.940675 9704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:36.948168 9704 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:34825
I20260810 04:54:36.948233 9895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:34825 every 8 connection(s)
I20260810 04:54:36.948654 9704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:54:36.949986 9899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:36.949500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:34001)
0810 04:54:36.949698 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:36.949787 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260810 04:54:36.950312 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 9704
W20260810 04:54:36.950503 9896 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:44087 (0 consecutive failures): Network error: Failed to ping master at 127.15.239.254:44087: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
I20260810 04:54:36.950706 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:44325
--local_ip_for_outbound_sockets=127.15.239.195
--tserver_master_addrs=127.15.239.254:44087
--webserver_port=42497
--webserver_interface=127.15.239.195
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:54:36.950873 9899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:36.950728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:59465)
0810 04:54:36.950789 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:36.950829 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:54:36.951196 9899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:36.951118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:48541)
0810 04:54:36.951158 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:36.951181 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 04:54:36.951324 9896 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 04:54:37.062752 9900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:37.063181 9900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:37.063239 9900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:37.065148 9900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:37.065227 9900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:37.065276 9900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:54:37.067672 9900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:44325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=42497
--tserver_master_addrs=127.15.239.254:44087
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:37.068038 9900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:37.068435 9900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:37.075850 9911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:37.075873 9907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:37.075873 9906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:37.076207 9900 server_base.cc:1034] running on GCE node
I20260810 04:54:37.076499 9900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:37.076932 9900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:37.078125 9900 hybrid_clock.cc:648] HybridClock initialized: now 1786337677078109 us; error 41 us; skew 500 ppm
Aug 10 04:54:37 dist-test-slave-kvfs krb5kdc[7695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337677, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:37.081918 9900 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:54:37.082520 9900 webserver.cc:460] Webserver started at http://127.15.239.195:42497/ using document root <none> and password file <none>
I20260810 04:54:37.082793 9900 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:37.082870 9900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:37.084681 9900 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:54:37.085503 9922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:37.085711 9900 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:54:37.085830 9900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "32c5eb92d341469da51ad759e2be1a5a"
format_stamp: "Formatted at 2026-08-10 04:53:54 on dist-test-slave-kvfs"
server_key: "3ef8a035cdbd8e589cd2db1e89b84916"
server_key_iv: "875db2846e7611c13d672e9eeb589065"
server_key_version: "encryptionkey@0"
I20260810 04:54:37.086292 9900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:37.095227 9900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:37.097646 9900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:37.097819 9900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:37.098093 9900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:37.098455 9900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:37.098517 9900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:37.098563 9900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:37.098588 9900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:37.105990 9900 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:44325
I20260810 04:54:37.106067 10105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:44325 every 8 connection(s)
I20260810 04:54:37.106469 9900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:54:37.107722 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:37.107262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:40027)
0810 04:54:37.107445 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:37.107552 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
W20260810 04:54:37.108294 10107 heartbeater.cc:644] Failed to heartbeat to 127.15.239.254:44087 (0 consecutive failures): Network error: Failed to ping master at 127.15.239.254:44087: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
I20260810 04:54:37.108628 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:37.108528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:56695)
0810 04:54:37.108578 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:37.108608 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 04:54:37.108970 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:37.108873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:34713)
0810 04:54:37.108923 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:37.108953 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:54:37.109076 10107 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 04:54:37.113710 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 9900
I20260810 04:54:37.894888 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:37.894507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:38775)
0810 04:54:37.894729 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:37.894787 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":110,"threads_started":1}
I20260810 04:54:37.951932 10113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:37.951671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:33333)
0810 04:54:37.951820 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:37.951860 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260810 04:54:38.109741 10114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.109466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:43605)
0810 04:54:38.109630 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:38.109673 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260810 04:54:38.457857 10115 raft_consensus.cc:482] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:38.458047 10115 raft_consensus.cc:504] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:38.458575 10115 leader_election.cc:288] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825), 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325)
Aug 10 04:54:38 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.195@KRBTEST.COM
Aug 10 04:54:38 dist-test-slave-kvfs krb5kdc[7695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337676, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.194@KRBTEST.COM
I20260810 04:54:38.470633 10117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.458756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:34825 (local address 127.15.239.193:44243)
0810 04:54:38.458939 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:38.458953 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:38.459037 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:38.460150 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:38.460152 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:38.460559 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:38.460816 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:38.460824 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.462120 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.462121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:38.462957 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:38.462960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.463614 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.463615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:38.463747 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:38.464649 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:38.464654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:38.466690 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:38.468917 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:38.468917 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:38.468918 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:38.469191 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:38.469490 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:38.469491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:38.469492 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:38.469589 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:38.470028 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:38.470035 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:38.470171 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 04:54:38.470287 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 04:54:38.470520 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":24,"thread_start_us":95,"threads_started":1}
I20260810 04:54:38.470647 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.458960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:53833 (local address 127.15.239.195:44325)
0810 04:54:38.459181 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:38.459194 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:38.459231 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:54:38.459810 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:38.459812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:38.459866 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:38.460083 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:38.460954 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.461971 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.463098 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.463503 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.463627 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:38.466683 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:38.466688 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:38.466689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:38.466703 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:38.468733 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:38.469268 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:38.469272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:38.469273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:38.469390 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:38.469663 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:38.469664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:38.469665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:38.469941 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:38.470045 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:38.470362 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 04:54:38.470506 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":112,"threads_started":1}
I20260810 04:54:38.470659 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.458915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:44243 (local address 127.15.239.194:34825)
0810 04:54:38.459181 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:38.459194 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:38.459220 (+ 26us) server_negotiation.cc:407] Connection header received
0810 04:54:38.459804 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:38.459806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:38.459858 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:38.460059 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:38.460971 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.461970 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.463059 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.463507 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.463635 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:38.466790 (+ 3155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:38.466794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:38.466794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:38.466804 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:38.468824 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:38.469305 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:38.469307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:38.469307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:38.469397 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:38.469668 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:38.469669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:38.469669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:38.469941 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:38.470043 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:38.470363 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 04:54:38.470511 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":116,"threads_started":1}
I20260810 04:54:38.470743 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.458756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44325 (local address 127.15.239.193:53833)
0810 04:54:38.458921 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:38.458934 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:38.459018 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:38.460109 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:38.460113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:38.460560 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:38.460816 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:38.460824 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.462117 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.462118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:38.462957 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:38.462961 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:38.463602 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:38.463603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:38.463747 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:38.464596 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:38.464606 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:38.466559 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:38.468830 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:38.468838 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:38.468841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:38.469178 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:38.469464 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:38.469465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:38.469465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:38.469588 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:38.470036 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:38.470037 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:38.470171 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 04:54:38.470287 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 04:54:38.470605 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":219,"thread_start_us":86,"threads_started":1}
W20260810 04:54:38.472404 9528 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
W20260810 04:54:38.472548 9530 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
I20260810 04:54:38.472618 9530 leader_election.cc:302] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cb756688ead4133a0df910629835442; no voters: 32c5eb92d341469da51ad759e2be1a5a, 39d4ef03acec448d9fe459608e4d7525
I20260810 04:54:38.472775 10115 raft_consensus.cc:2726] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:54:38.895717 10116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.895527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:35655)
0810 04:54:38.895609 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:38.895653 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 04:54:38.952741 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:38.952435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:60589)
0810 04:54:38.952620 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:38.952682 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":104,"threads_started":1}
I20260810 04:54:39.110559 10123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:39.110308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:40199)
0810 04:54:39.110468 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:39.110510 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
I20260810 04:54:39.896644 10124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:39.896349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:47811)
0810 04:54:39.896526 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:39.896569 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":98,"threads_started":1}
I20260810 04:54:39.953605 10125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:39.953293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:38385)
0810 04:54:39.953464 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:39.953541 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":84,"threads_started":1}
I20260810 04:54:39.979487 10126 raft_consensus.cc:482] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:39.979609 10126 raft_consensus.cc:504] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:39.979866 10126 leader_election.cc:288] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825), 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325)
W20260810 04:54:39.980378 9530 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
W20260810 04:54:39.980469 9528 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
I20260810 04:54:39.980509 9528 leader_election.cc:302] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cb756688ead4133a0df910629835442; no voters: 32c5eb92d341469da51ad759e2be1a5a, 39d4ef03acec448d9fe459608e4d7525
I20260810 04:54:39.980598 10126 raft_consensus.cc:2726] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:54:40.111537 10127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:40.111174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:53939)
0810 04:54:40.111391 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:40.111446 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":112,"threads_started":1}
I20260810 04:54:40.897614 10128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:40.897295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:44545)
0810 04:54:40.897487 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:40.897536 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260810 04:54:40.954507 10129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:40.954211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:38467)
0810 04:54:40.954388 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:40.954437 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260810 04:54:41.112428 10130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:41.112141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:53945)
0810 04:54:41.112318 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:41.112359 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
I20260810 04:54:41.898761 10132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:41.898417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:57789)
0810 04:54:41.898632 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:41.898693 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":118,"threads_started":1}
I20260810 04:54:41.955502 10133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:41.955179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:60891)
0810 04:54:41.955387 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:41.955425 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":137,"threads_started":1}
I20260810 04:54:42.113421 10135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:42.113073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:35089)
0810 04:54:42.113292 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:42.113351 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":118,"threads_started":1}
I20260810 04:54:42.749907 10136 raft_consensus.cc:482] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:42.750085 10136 raft_consensus.cc:504] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:42.750351 10136 leader_election.cc:288] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825), 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325)
W20260810 04:54:42.750922 9530 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
W20260810 04:54:42.751039 9528 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
I20260810 04:54:42.751078 9528 leader_election.cc:302] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cb756688ead4133a0df910629835442; no voters: 32c5eb92d341469da51ad759e2be1a5a, 39d4ef03acec448d9fe459608e4d7525
I20260810 04:54:42.751185 10136 raft_consensus.cc:2726] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:54:42.899721 10137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:42.899412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:59039)
0810 04:54:42.899597 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:42.899649 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":100,"threads_started":1}
I20260810 04:54:42.956645 10139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:42.956293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:53989)
0810 04:54:42.956517 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:42.956578 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":105,"threads_started":1}
I20260810 04:54:43.114530 10140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:43.114169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:36219)
0810 04:54:43.114397 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:43.114457 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":115,"threads_started":1}
I20260810 04:54:43.901015 10141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:43.900607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:54521)
0810 04:54:43.900859 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:43.900926 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":119,"threads_started":1}
I20260810 04:54:43.957594 10143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:43.957255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:53185)
0810 04:54:43.957472 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:43.957526 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":109,"threads_started":1}
I20260810 04:54:44.115672 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:44.115341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:35105)
0810 04:54:44.115537 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:44.115598 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
I20260810 04:54:44.902273 10146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:44.901763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:42793)
0810 04:54:44.902104 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:44.902172 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":173,"threads_started":1}
I20260810 04:54:44.958385 10148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:44.958112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:52367)
0810 04:54:44.958275 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:44.958317 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":85,"threads_started":1}
I20260810 04:54:45.116725 10150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:45.116362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:53893)
0810 04:54:45.116596 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:45.116642 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":129,"threads_started":1}
I20260810 04:54:45.903308 10151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:45.903001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:43135)
0810 04:54:45.903175 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:45.903232 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":94,"threads_started":1}
I20260810 04:54:45.959477 10154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:45.959136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:60939)
0810 04:54:45.959353 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:45.959408 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":109,"threads_started":1}
I20260810 04:54:46.117720 10155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:46.117363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:58567)
0810 04:54:46.117593 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:46.117645 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":122,"threads_started":1}
I20260810 04:54:46.772284 10157 raft_consensus.cc:482] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:46.772444 10157 raft_consensus.cc:504] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d4ef03acec448d9fe459608e4d7525" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 34825 } } peers { permanent_uuid: "32c5eb92d341469da51ad759e2be1a5a" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44325 } } peers { permanent_uuid: "5cb756688ead4133a0df910629835442" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 33881 } }
I20260810 04:54:46.772737 10157 leader_election.cc:288] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825), 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325)
W20260810 04:54:46.773274 9528 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32c5eb92d341469da51ad759e2be1a5a (127.15.239.195:44325): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
W20260810 04:54:46.773414 9530 leader_election.cc:341] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 39d4ef03acec448d9fe459608e4d7525 (127.15.239.194:34825): Not found: Tablet not found: 9c66cad0337f4d518d93029d87948f46
I20260810 04:54:46.773485 9530 leader_election.cc:302] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cb756688ead4133a0df910629835442; no voters: 32c5eb92d341469da51ad759e2be1a5a, 39d4ef03acec448d9fe459608e4d7525
I20260810 04:54:46.773589 10157 raft_consensus.cc:2726] T 9c66cad0337f4d518d93029d87948f46 P 5cb756688ead4133a0df910629835442 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 04:54:46.904505 10158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:46.904137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:46821)
0810 04:54:46.904355 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:46.904413 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":111,"threads_started":1}
I20260810 04:54:46.960625 10160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:46.960306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:54205)
0810 04:54:46.960503 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:46.960556 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":115,"threads_started":1}
I20260810 04:54:47.118609 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:47.118337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:58685)
0810 04:54:47.118486 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:47.118536 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260810 04:54:47.905454 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:47.905132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:45941)
0810 04:54:47.905330 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:47.905379 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":125,"threads_started":1}
I20260810 04:54:47.961587 10164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:47.961242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:51485)
0810 04:54:47.961435 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:47.961505 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":119,"threads_started":1}
I20260810 04:54:48.119684 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:48.119244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:43329)
0810 04:54:48.119443 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:48.119561 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":92,"threads_started":1}
I20260810 04:54:48.906323 10173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:48.906015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:59557)
0810 04:54:48.906204 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:48.906247 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":91,"threads_started":1}
I20260810 04:54:48.962524 10174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:48.962200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:59685)
0810 04:54:48.962395 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:48.962453 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":102,"threads_started":1}
I20260810 04:54:49.120705 10175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:49.120354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:52985)
0810 04:54:49.120565 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:49.120617 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":91,"threads_started":1}
I20260810 04:54:49.907262 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:49.906982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:45675)
0810 04:54:49.907141 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:49.907188 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260810 04:54:49.963351 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:49.963087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:52141)
0810 04:54:49.963242 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:49.963284 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260810 04:54:50.121706 10182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:50.121370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:40831)
0810 04:54:50.121570 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:50.121628 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":89,"threads_started":1}
I20260810 04:54:50.908259 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:50.907875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:33825)
0810 04:54:50.908137 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:50.908187 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":116,"threads_started":1}
I20260810 04:54:50.964234 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:50.963927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:44091)
0810 04:54:50.964124 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:50.964166 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":138,"threads_started":1}
I20260810 04:54:51.122756 10188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:51.122396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:38609)
0810 04:54:51.122610 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:51.122675 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":108,"threads_started":1}
I20260810 04:54:51.909251 10189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:51.908954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.193:48399)
0810 04:54:51.909134 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:51.909180 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260810 04:54:51.965344 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:51.964888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.194:56483)
0810 04:54:51.965178 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:51.965254 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":142,"threads_started":1}
I20260810 04:54:52.124083 10191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:52.123629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:44087 (local address 127.15.239.195:42267)
0810 04:54:52.123832 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:52.123953 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.254:44087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":93,"threads_started":1}
I20260810 04:54:52.124279 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 9437
I20260810 04:54:52.148550 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 9704
I20260810 04:54:52.163162 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 9900
2026-08-10T04:54:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59579 ms)
[----------] 30 tests from SecurityITest (256776 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:54:52 dist-test-slave-kvfs krb5kdc[10196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:54:52 dist-test-slave-kvfs krb5kdc[10196](info): set up 2 sockets
Aug 10 04:54:52 dist-test-slave-kvfs krb5kdc[10196](info): commencing operation
krb5kdc: starting...
W20260810 04:54:53.468607 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:54:53 dist-test-slave-kvfs krb5kdc[10196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:54:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:54:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:54:53.607617 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:43871
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:43871
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:53.704936 10216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:53.705188 10216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:53.705210 10216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:53.706458 10216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:54:53.706506 10216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:53.706519 10216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:53.706532 10216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:54:53.706544 10216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:54:53.708266 10216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:43871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:43871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:53.708601 10216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:53.708901 10216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:53.715298 10225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:53.715332 10216 server_base.cc:1034] running on GCE node
W20260810 04:54:53.715283 10229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:53.715387 10226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:53.715989 10216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:53.716423 10216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:53.717604 10216 hybrid_clock.cc:648] HybridClock initialized: now 1786337693717594 us; error 54 us; skew 500 ppm
Aug 10 04:54:53 dist-test-slave-kvfs krb5kdc[10196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337693, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:53.720755 10216 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:54:53.721371 10216 webserver.cc:460] Webserver started at http://127.15.239.254:38821/ using document root <none> and password file <none>
I20260810 04:54:53.721673 10216 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:53.721751 10216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:53.721931 10216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:53.723198 10216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "36333494363644a58d365ad36ff579c7"
format_stamp: "Formatted at 2026-08-10 04:54:53 on dist-test-slave-kvfs"
server_key: "a17f7581c47217cb9f38b08ad7ce4b9a"
server_key_iv: "d764f3bac974206ab3e5c68d26585c19"
server_key_version: "encryptionkey@0"
I20260810 04:54:53.723636 10216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "36333494363644a58d365ad36ff579c7"
format_stamp: "Formatted at 2026-08-10 04:54:53 on dist-test-slave-kvfs"
server_key: "a17f7581c47217cb9f38b08ad7ce4b9a"
server_key_iv: "d764f3bac974206ab3e5c68d26585c19"
server_key_version: "encryptionkey@0"
I20260810 04:54:53.725277 10216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:54:53.726152 10238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:53.726472 10216 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:54:53.726595 10216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "36333494363644a58d365ad36ff579c7"
format_stamp: "Formatted at 2026-08-10 04:54:53 on dist-test-slave-kvfs"
server_key: "a17f7581c47217cb9f38b08ad7ce4b9a"
server_key_iv: "d764f3bac974206ab3e5c68d26585c19"
server_key_version: "encryptionkey@0"
I20260810 04:54:53.726679 10216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:53.741706 10216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:53.744932 10216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:53.745182 10216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:53.751560 10216 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:43871
I20260810 04:54:53.751662 10310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:43871 every 8 connection(s)
I20260810 04:54:53.752226 10216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:54:53.753486 10311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:53.755008 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 10216
I20260810 04:54:53.755151 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:54:53.755419 16319 external_mini_cluster.cc:1428] Setting key 8b555fabee583de1b5129aa0fde461b0
I20260810 04:54:53.757244 10311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7: Bootstrap starting.
I20260810 04:54:53.758282 10311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:53.758658 10311 log.cc:824] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:53.759578 10311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7: No bootstrap required, opened a new log
I20260810 04:54:53.762511 10311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36333494363644a58d365ad36ff579c7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43871 } }
I20260810 04:54:53.762782 10311 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:53.762832 10311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36333494363644a58d365ad36ff579c7, State: Initialized, Role: FOLLOWER
I20260810 04:54:53.763018 10311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36333494363644a58d365ad36ff579c7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43871 } }
I20260810 04:54:53.763121 10311 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:54:53.763165 10311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:54:53.763230 10311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 04:54:53 dist-test-slave-kvfs krb5kdc[10196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:53.764070 10311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36333494363644a58d365ad36ff579c7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43871 } }
I20260810 04:54:53.764242 10311 leader_election.cc:302] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36333494363644a58d365ad36ff579c7; no voters:
I20260810 04:54:53.764484 10311 leader_election.cc:288] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:54:53.764514 10319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:53.764726 10319 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [term 1 LEADER]: Becoming Leader. State: Replica: 36333494363644a58d365ad36ff579c7, State: Running, Role: LEADER
I20260810 04:54:53.764940 10311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:54:53.764937 10319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36333494363644a58d365ad36ff579c7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43871 } }
I20260810 04:54:53.765553 10321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36333494363644a58d365ad36ff579c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36333494363644a58d365ad36ff579c7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43871 } } }
I20260810 04:54:53.765563 10320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36333494363644a58d365ad36ff579c7. Latest consensus state: current_term: 1 leader_uuid: "36333494363644a58d365ad36ff579c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36333494363644a58d365ad36ff579c7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43871 } } }
I20260810 04:54:53.765795 10321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:53.765801 10320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7 [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:53.766103 10331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:54:53.766862 10331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:54:53.769138 10331 catalog_manager.cc:1347] Generated new cluster ID: a41cac44f4fc4956a71116942e0c494d
I20260810 04:54:53.769208 10331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:54:53.769975 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:53.756196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.15.239.254:43871)
0810 04:54:53.756415 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:53.756426 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:53.756458 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:54:53.756952 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:53.756961 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:53.757044 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:53.757192 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:53.758235 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:53.759452 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:53.760641 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:53.761173 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:53.761288 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:53.764620 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:53.764627 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:53.764627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:53.764647 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:53.767416 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:53.767991 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:53.767995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:53.767996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:53.768165 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:53.768424 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:53.768425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:53.768426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:53.768829 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:53.769008 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:53.769585 (+ 577us) server_negotiation.cc:299] Negotiation successful
0810 04:54:53.769743 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260810 04:54:53.775807 10331 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:54:53.776439 10331 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:54:53.782094 10331 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7: Generated new TSK 0
I20260810 04:54:53.782371 10331 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:54:53.820412 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43871
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:53.922384 10355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:53.922678 10355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:53.922708 10355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:53.924129 10355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:53.924182 10355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:53.924213 10355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:54:53.925905 10355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:53.926242 10355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:53.926558 10355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:53.933337 10363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:53.933300 10361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:53.933439 10355 server_base.cc:1034] running on GCE node
W20260810 04:54:53.933555 10365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:53.933943 10355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:53.934250 10355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:53.935403 10355 hybrid_clock.cc:648] HybridClock initialized: now 1786337693935387 us; error 35 us; skew 500 ppm
Aug 10 04:54:53 dist-test-slave-kvfs krb5kdc[10196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337693, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:53.938768 10355 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:54:53.939388 10355 webserver.cc:460] Webserver started at http://127.15.239.193:44311/ using document root <none> and password file <none>
I20260810 04:54:53.939661 10355 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:53.939708 10355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:53.939821 10355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:53.941211 10355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "be8f27f1f6454e8884ca5b580caecefd"
format_stamp: "Formatted at 2026-08-10 04:54:53 on dist-test-slave-kvfs"
server_key: "6b0d15633716fbb7d48ddd83c5a63492"
server_key_iv: "d1635137c21dfce210993a546ac63670"
server_key_version: "encryptionkey@0"
I20260810 04:54:53.941589 10355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "be8f27f1f6454e8884ca5b580caecefd"
format_stamp: "Formatted at 2026-08-10 04:54:53 on dist-test-slave-kvfs"
server_key: "6b0d15633716fbb7d48ddd83c5a63492"
server_key_iv: "d1635137c21dfce210993a546ac63670"
server_key_version: "encryptionkey@0"
I20260810 04:54:53.943187 10355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:54:53.944268 10375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:53.944484 10355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:53.944617 10355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "be8f27f1f6454e8884ca5b580caecefd"
format_stamp: "Formatted at 2026-08-10 04:54:53 on dist-test-slave-kvfs"
server_key: "6b0d15633716fbb7d48ddd83c5a63492"
server_key_iv: "d1635137c21dfce210993a546ac63670"
server_key_version: "encryptionkey@0"
I20260810 04:54:53.944715 10355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:53.961376 10355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:53.964195 10355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:53.964408 10355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:53.964707 10355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:53.965106 10355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:53.965183 10355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:53.965227 10355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:53.965276 10355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:53.972512 10355 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:34235
I20260810 04:54:53.972563 10561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:34235 every 8 connection(s)
I20260810 04:54:53.973011 10355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:54:53.978782 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 10355
I20260810 04:54:53.978890 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:54:53.979449 16319 external_mini_cluster.cc:1428] Setting key 41273f491d3cd19dfea7f7a9ef8c1eb8
Aug 10 04:54:53 dist-test-slave-kvfs krb5kdc[10196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337693, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:53.985006 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:53.974061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:32831 (local address 127.15.239.254:43871)
0810 04:54:53.974195 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:53.974198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:53.974408 (+ 210us) server_negotiation.cc:407] Connection header received
0810 04:54:53.975125 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:53.975127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:53.975143 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:53.975206 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:53.976402 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:53.977014 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:53.978163 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:53.978406 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:53.978499 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:53.981338 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:53.981340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:53.981341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:53.981350 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:53.983214 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:53.983694 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:53.983696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:53.983696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:53.983789 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:53.984122 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:53.984123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:53.984124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:53.984308 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:53.984392 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:53.984715 (+ 323us) server_negotiation.cc:299] Negotiation successful
0810 04:54:53.984837 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 04:54:53.985044 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:53.973972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:43871 (local address 127.15.239.193:32831)
0810 04:54:53.974231 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:53.974291 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:53.974991 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:53.975298 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:53.975304 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:53.976007 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:53.976285 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:53.976291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:53.977128 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:53.977129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:53.978048 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:53.978050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:53.978512 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:53.978513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:53.978683 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:53.979322 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:53.979334 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:53.981221 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:53.983317 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:53.983325 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:53.983328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:53.983609 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:53.983860 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:53.983861 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:53.983861 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:53.984006 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:53.984381 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:53.984388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:53.984550 (+ 162us) client_negotiation.cc:769] Sending connection context
0810 04:54:53.984643 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 04:54:53.984806 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":106,"threads_started":1}
I20260810 04:54:53.986043 10562 heartbeater.cc:347] Connected to a master server at 127.15.239.254:43871
I20260810 04:54:53.986191 10562 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:53.986449 10562 heartbeater.cc:511] Master 127.15.239.254:43871 requested a full tablet report, sending...
I20260810 04:54:53.987231 10260 ts_manager.cc:194] Registered new tserver with Master: be8f27f1f6454e8884ca5b580caecefd (127.15.239.193:34235)
I20260810 04:54:53.987995 10260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:32831
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:54:54.015844 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43871
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:54.115110 10571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:54.115381 10571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:54.115408 10571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:54.116758 10571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:54.116811 10571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:54.116868 10571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:54:54.118507 10571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:54.118804 10571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:54.119086 10571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:54.125041 10579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.125097 10581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.125026 10578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:54.125213 10571 server_base.cc:1034] running on GCE node
I20260810 04:54:54.125571 10571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:54.125918 10571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:54.127131 10571 hybrid_clock.cc:648] HybridClock initialized: now 1786337694127113 us; error 47 us; skew 500 ppm
Aug 10 04:54:54 dist-test-slave-kvfs krb5kdc[10196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337694, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:54.130512 10571 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:54:54.131152 10571 webserver.cc:460] Webserver started at http://127.15.239.194:36321/ using document root <none> and password file <none>
I20260810 04:54:54.131438 10571 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:54.131515 10571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:54.131680 10571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:54.133018 10571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "c7cc73525e454382be396a25886319e8"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "64c41e118d0b7ebaebcf5e37ecb6f9ab"
server_key_iv: "e0dd970cea2653bf56c049b5f6507f31"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.133445 10571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "c7cc73525e454382be396a25886319e8"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "64c41e118d0b7ebaebcf5e37ecb6f9ab"
server_key_iv: "e0dd970cea2653bf56c049b5f6507f31"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.135075 10571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:54:54.135962 10593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.136188 10571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:54.136312 10571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c7cc73525e454382be396a25886319e8"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "64c41e118d0b7ebaebcf5e37ecb6f9ab"
server_key_iv: "e0dd970cea2653bf56c049b5f6507f31"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.136404 10571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:54.146740 10571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:54.149526 10571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:54.149735 10571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:54.150099 10571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:54.150621 10571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:54.150669 10571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.150709 10571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:54.150753 10571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.158222 10571 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:42195
I20260810 04:54:54.158278 10760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:42195 every 8 connection(s)
I20260810 04:54:54.158730 10571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:54:54.164903 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 10571
I20260810 04:54:54.165081 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:54:54.165374 16319 external_mini_cluster.cc:1428] Setting key 4eee343ba7215490c1e5741dc69cd381
Aug 10 04:54:54 dist-test-slave-kvfs krb5kdc[10196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337694, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:54.170332 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.159819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:52015 (local address 127.15.239.254:43871)
0810 04:54:54.159931 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.159934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.160193 (+ 259us) server_negotiation.cc:407] Connection header received
0810 04:54:54.160813 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.160814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.160827 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.160886 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:54.162021 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.162600 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.163703 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.163904 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.163970 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.167117 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:54.167119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:54.167119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:54.167127 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:54.168725 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:54.169215 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:54.169216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:54.169217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:54.169294 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:54.169559 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:54.169560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:54.169561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:54.169726 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:54.169803 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.170089 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.170202 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 04:54:54.170439 10763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.159802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:43871 (local address 127.15.239.194:52015)
0810 04:54:54.160050 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.160112 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.160711 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.160953 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.160958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.161648 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:54.161902 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.161908 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.162693 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.162694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.163615 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.163618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.163998 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.163999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.164196 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.164864 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:54.164875 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:54.167017 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:54.168831 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:54.168841 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:54.168845 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:54.169136 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:54.169365 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:54.169366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:54.169366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:54.169494 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:54.169794 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:54.169799 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:54.169943 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.170041 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.170192 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":108,"threads_started":1}
I20260810 04:54:54.171016 10761 heartbeater.cc:347] Connected to a master server at 127.15.239.254:43871
I20260810 04:54:54.171137 10761 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:54.171383 10761 heartbeater.cc:511] Master 127.15.239.254:43871 requested a full tablet report, sending...
I20260810 04:54:54.171866 10260 ts_manager.cc:194] Registered new tserver with Master: c7cc73525e454382be396a25886319e8 (127.15.239.194:42195)
I20260810 04:54:54.172341 10260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:52015
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:54:54.200130 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43871
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:54.303372 10766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:54.303675 10766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:54.303718 10766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:54.305074 10766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:54.305156 10766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:54.305207 10766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:54:54.306871 10766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:54.307224 10766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:54.307551 10766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:54.313805 10772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.313805 10773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.313819 10776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:54.314152 10766 server_base.cc:1034] running on GCE node
I20260810 04:54:54.314433 10766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:54.314740 10766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:54.315940 10766 hybrid_clock.cc:648] HybridClock initialized: now 1786337694315932 us; error 65 us; skew 500 ppm
Aug 10 04:54:54 dist-test-slave-kvfs krb5kdc[10196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337694, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:54.319209 10766 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:54:54.319773 10766 webserver.cc:460] Webserver started at http://127.15.239.195:44417/ using document root <none> and password file <none>
I20260810 04:54:54.320130 10766 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:54.320207 10766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:54.320389 10766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:54.321786 10766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "945825e8dbb046f78e3c140f98a8bb24"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "40f4d8d56688b685d0e3d248b649a7be"
server_key_iv: "075cb65a85a5be2dcbe648f9f671087d"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.322224 10766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "945825e8dbb046f78e3c140f98a8bb24"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "40f4d8d56688b685d0e3d248b649a7be"
server_key_iv: "075cb65a85a5be2dcbe648f9f671087d"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.323824 10766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:54:54.324816 10788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.325045 10766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:54.325176 10766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "945825e8dbb046f78e3c140f98a8bb24"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "40f4d8d56688b685d0e3d248b649a7be"
server_key_iv: "075cb65a85a5be2dcbe648f9f671087d"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.325268 10766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:54.338006 10766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:54.341066 10766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:54.341259 10766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:54.341573 10766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:54.341980 10766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:54.342020 10766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.342046 10766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:54.342059 10766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.349721 10766 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:33055
I20260810 04:54:54.349814 10965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:33055 every 8 connection(s)
I20260810 04:54:54.350229 10766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
Aug 10 04:54:54 dist-test-slave-kvfs krb5kdc[10196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337694, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:54.359764 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 10766
I20260810 04:54:54.359892 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:54:54.360194 16319 external_mini_cluster.cc:1428] Setting key 6adef2ff4ca29caffac9f8629c638d94
I20260810 04:54:54.361793 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.351286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:56881 (local address 127.15.239.254:43871)
0810 04:54:54.351391 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.351393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.351608 (+ 215us) server_negotiation.cc:407] Connection header received
0810 04:54:54.352341 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.352343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.352359 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.352429 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:54.353600 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.354184 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.355333 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.355566 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.355646 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.358374 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:54.358376 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:54.358376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:54.358386 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:54.360067 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:54.360562 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:54.360563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:54.360564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:54.360645 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:54.361071 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:54.361073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:54.361073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:54.361246 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:54.361346 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.361630 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.361713 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:54:54.362103 10970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.351246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:43871 (local address 127.15.239.195:56881)
0810 04:54:54.351455 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.351503 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.352215 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.352525 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.352529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.353228 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:54.353483 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.353489 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.354293 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.354294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.355221 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.355223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.355653 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.355654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.355814 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.356482 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:54.356494 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:54.358247 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:54.360150 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:54.360157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:54.360159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:54.360452 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:54.360823 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:54.360824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:54.360825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:54.361013 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:54.361326 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:54.361334 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:54.361504 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.361600 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.361753 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":98,"threads_started":1}
I20260810 04:54:54.362708 10967 heartbeater.cc:347] Connected to a master server at 127.15.239.254:43871
I20260810 04:54:54.362900 10967 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:54.363165 10967 heartbeater.cc:511] Master 127.15.239.254:43871 requested a full tablet report, sending...
I20260810 04:54:54.363716 10260 ts_manager.cc:194] Registered new tserver with Master: 945825e8dbb046f78e3c140f98a8bb24 (127.15.239.195:33055)
I20260810 04:54:54.364336 10260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:56881
I20260810 04:54:54.372884 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:54:54.381887 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.374673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53500 (local address 127.15.239.254:43871)
0810 04:54:54.374749 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.374751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.374883 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:54:54.374945 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.374946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.374956 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.375009 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:54.375684 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.376330 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.377130 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.377327 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.377382 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.378817 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:54.378818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:54.378819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:54.378826 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:54.380491 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:54.380931 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:54.380932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:54.380933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:54.380999 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:54.381270 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:54.381271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:54.381272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:54.381492 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:54.381591 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.381728 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.381804 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:54:54.384222 10260 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:54:54.386322 10260 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:54:54.394608 10989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.389730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.15.239.195:33055)
0810 04:54:54.390008 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.390016 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.390148 (+ 132us) server_negotiation.cc:407] Connection header received
0810 04:54:54.390338 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.390340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.390361 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.390423 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.390756 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.392172 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.393514 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.394080 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.394191 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.394267 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.394421 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.394498 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":127,"threads_started":1}
I20260810 04:54:54.394627 10992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.389867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34235 (local address 127.0.0.1:50332)
0810 04:54:54.390137 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.390148 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.390205 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.390880 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.390881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.390883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.390919 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.390920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.392367 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.392368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.393344 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.393347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.394358 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.394359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.394421 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.394425 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.394479 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.394545 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":83,"threads_started":1}
I20260810 04:54:54.394897 10985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.389599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:33055 (local address 127.0.0.1:35100)
0810 04:54:54.390003 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.390060 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.390205 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.390576 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.390581 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.390584 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.390686 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.390689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.392307 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.392308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.393412 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.393414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.394190 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.394192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.394284 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.394301 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.394758 (+ 457us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.394811 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":49,"thread_start_us":90,"threads_started":1}
I20260810 04:54:54.394961 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.389813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46186 (local address 127.15.239.194:42195)
0810 04:54:54.390392 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.390499 (+ 107us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.390511 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:54:54.390568 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.390570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.390587 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.390670 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.390905 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.391683 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.393309 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.394197 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.394289 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.394362 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.394798 (+ 436us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.394866 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":120,"threads_started":1}
I20260810 04:54:54.395131 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.389686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42195 (local address 127.0.0.1:46186)
0810 04:54:54.390103 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.390117 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.390205 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.390771 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.390771 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.390774 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.390820 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.390821 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.391802 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.391803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.393197 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.393201 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.394412 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.394413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.394495 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.394500 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.394557 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.394603 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":121,"threads_started":1}
I20260810 04:54:54.394657 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.390198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50332 (local address 127.15.239.193:34235)
0810 04:54:54.390671 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.390676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.390689 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:54:54.390739 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.390742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.390762 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.390867 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.390979 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.392228 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.393470 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.394246 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.394356 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.394416 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.394493 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.394552 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":121,"threads_started":1}
I20260810 04:54:54.396072 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 4397174c20854ee383a0a0af91b34b57 (DEFAULT_TABLE table=test-table [id=d492910b67df42f2a8d144bf72e44181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:54.396099 10665 tablet_service.cc:1467] Processing CreateTablet for tablet 4397174c20854ee383a0a0af91b34b57 (DEFAULT_TABLE table=test-table [id=d492910b67df42f2a8d144bf72e44181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:54.396152 10457 tablet_service.cc:1467] Processing CreateTablet for tablet 4397174c20854ee383a0a0af91b34b57 (DEFAULT_TABLE table=test-table [id=d492910b67df42f2a8d144bf72e44181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:54.396585 10457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4397174c20854ee383a0a0af91b34b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:54.396585 10665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4397174c20854ee383a0a0af91b34b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:54.396585 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4397174c20854ee383a0a0af91b34b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:54.400050 10994 tablet_bootstrap.cc:492] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: Bootstrap starting.
I20260810 04:54:54.400717 10995 tablet_bootstrap.cc:492] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Bootstrap starting.
I20260810 04:54:54.401116 10994 tablet_bootstrap.cc:654] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:54.401641 10995 tablet_bootstrap.cc:654] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:54.401919 10994 log.cc:824] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:54.402401 10995 log.cc:824] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:54.402458 10996 tablet_bootstrap.cc:492] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Bootstrap starting.
I20260810 04:54:54.403260 10996 tablet_bootstrap.cc:654] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:54.403337 10995 tablet_bootstrap.cc:492] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: No bootstrap required, opened a new log
I20260810 04:54:54.403434 10995 ts_tablet_manager.cc:1397] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:54:54.403954 10996 log.cc:824] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:54.404670 10994 tablet_bootstrap.cc:492] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: No bootstrap required, opened a new log
I20260810 04:54:54.404767 10994 ts_tablet_manager.cc:1397] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 04:54:54.406059 10995 raft_consensus.cc:348] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.406306 10995 raft_consensus.cc:374] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:54.406349 10995 raft_consensus.cc:729] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 945825e8dbb046f78e3c140f98a8bb24, State: Initialized, Role: FOLLOWER
I20260810 04:54:54.406529 10995 consensus_queue.cc:260] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.406913 10995 ts_tablet_manager.cc:1428] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 04:54:54.406922 10967 heartbeater.cc:503] Master 127.15.239.254:43871 was elected leader, sending a full tablet report...
I20260810 04:54:54.407269 10994 raft_consensus.cc:348] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.407511 10994 raft_consensus.cc:374] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:54.407593 10994 raft_consensus.cc:729] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8f27f1f6454e8884ca5b580caecefd, State: Initialized, Role: FOLLOWER
I20260810 04:54:54.407735 10994 consensus_queue.cc:260] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.407795 10996 tablet_bootstrap.cc:492] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: No bootstrap required, opened a new log
I20260810 04:54:54.407862 10996 ts_tablet_manager.cc:1397] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260810 04:54:54.408131 10562 heartbeater.cc:503] Master 127.15.239.254:43871 was elected leader, sending a full tablet report...
I20260810 04:54:54.408412 10994 ts_tablet_manager.cc:1428] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 04:54:54.410009 10996 raft_consensus.cc:348] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.410176 10996 raft_consensus.cc:374] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:54.410199 10996 raft_consensus.cc:729] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7cc73525e454382be396a25886319e8, State: Initialized, Role: FOLLOWER
I20260810 04:54:54.410283 10996 consensus_queue.cc:260] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.410503 10996 ts_tablet_manager.cc:1428] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:54:54.410593 10761 heartbeater.cc:503] Master 127.15.239.254:43871 was elected leader, sending a full tablet report...
I20260810 04:54:54.456115 11007 raft_consensus.cc:482] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:54.456360 11007 raft_consensus.cc:504] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.456880 11007 leader_election.cc:288] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 945825e8dbb046f78e3c140f98a8bb24 (127.15.239.195:33055), be8f27f1f6454e8884ca5b580caecefd (127.15.239.193:34235)
I20260810 04:54:54.457311 11005 raft_consensus.cc:482] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:54.457619 11005 raft_consensus.cc:504] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.458515 11005 leader_election.cc:288] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 945825e8dbb046f78e3c140f98a8bb24 (127.15.239.195:33055), c7cc73525e454382be396a25886319e8 (127.15.239.194:42195)
I20260810 04:54:54.461503 10763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.457191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:33055 (local address 127.15.239.194:52239)
0810 04:54:54.457274 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.457291 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.457377 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.457603 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.457604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.457606 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.457730 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.457733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.458976 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.458977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.460390 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.460393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.461188 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.461189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.461284 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.461288 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.461334 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.461389 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":74}
I20260810 04:54:54.461534 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.457422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:46009 (local address 127.15.239.193:34235)
0810 04:54:54.457473 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.457493 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.457637 (+ 144us) server_negotiation.cc:407] Connection header received
0810 04:54:54.457754 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.457755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.457768 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.457826 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.458109 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.458834 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.460502 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.461080 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.461128 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.461141 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.461427 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.461467 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:54:54.461755 11008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.457340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34235 (local address 127.15.239.194:46009)
0810 04:54:54.457559 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.457571 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.457669 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.457895 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.457896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.457899 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.458013 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.458015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.458937 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.458939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.460390 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.460393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.461198 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.461198 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.461274 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.461278 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.461327 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.461388 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":113,"thread_start_us":129,"threads_started":1}
I20260810 04:54:54.461972 10989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.457250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:52239 (local address 127.15.239.195:33055)
0810 04:54:54.457311 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.457313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.457442 (+ 129us) server_negotiation.cc:407] Connection header received
0810 04:54:54.457484 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.457485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.457499 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.457576 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.457826 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.458884 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.460504 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.461075 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.461144 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.461153 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.461846 (+ 693us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.461900 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:54:54.462283 10495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "c7cc73525e454382be396a25886319e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8f27f1f6454e8884ca5b580caecefd" is_pre_election: true
I20260810 04:54:54.462446 10495 raft_consensus.cc:2454] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7cc73525e454382be396a25886319e8 in term 0.
I20260810 04:54:54.462493 10894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "c7cc73525e454382be396a25886319e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "945825e8dbb046f78e3c140f98a8bb24" is_pre_election: true
I20260810 04:54:54.462606 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.458217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:33055 (local address 127.15.239.193:51809)
0810 04:54:54.458278 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.458290 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.458332 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.458880 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.458881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.458883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.458938 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.458939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.459972 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.459974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.461354 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.461357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.462317 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.462318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.462417 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.462422 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.462482 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.462535 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":74}
I20260810 04:54:54.462702 10594 leader_election.cc:302] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be8f27f1f6454e8884ca5b580caecefd, c7cc73525e454382be396a25886319e8; no voters:
I20260810 04:54:54.462684 10894 raft_consensus.cc:2454] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7cc73525e454382be396a25886319e8 in term 0.
I20260810 04:54:54.462904 11007 raft_consensus.cc:2781] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:54:54.463013 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.458462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:36665 (local address 127.15.239.194:42195)
0810 04:54:54.458515 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.458517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.458629 (+ 112us) server_negotiation.cc:407] Connection header received
0810 04:54:54.458729 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.458731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.458741 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.458772 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.459035 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.459876 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.461466 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.462015 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.462091 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.462099 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.462900 (+ 801us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.462951 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":95,"server-negotiator.queue_time_us":35}
I20260810 04:54:54.463057 11009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.458270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:51809 (local address 127.15.239.195:33055)
0810 04:54:54.458733 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.458735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.458744 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:54:54.458767 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.458768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.458778 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.459004 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:54.459043 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.459860 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.461468 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.462242 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.462321 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.462330 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.462594 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.462643 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":142,"threads_started":1}
I20260810 04:54:54.463181 11010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.458378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42195 (local address 127.15.239.193:36665)
0810 04:54:54.458562 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.458572 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.458654 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.458841 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.458842 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.458845 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:54.458938 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.458939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.459973 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.459974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.461354 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.461357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.462711 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.462714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.462798 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.462803 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.463028 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.463085 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":47,"thread_start_us":90,"threads_started":1}
I20260810 04:54:54.463006 11007 raft_consensus.cc:482] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:54:54.463321 11007 raft_consensus.cc:3037] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:54.463455 10894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "be8f27f1f6454e8884ca5b580caecefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "945825e8dbb046f78e3c140f98a8bb24" is_pre_election: true
I20260810 04:54:54.463542 10894 raft_consensus.cc:2454] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be8f27f1f6454e8884ca5b580caecefd in term 0.
I20260810 04:54:54.463498 10696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "be8f27f1f6454e8884ca5b580caecefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7cc73525e454382be396a25886319e8" is_pre_election: true
I20260810 04:54:54.463738 10376 leader_election.cc:302] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 945825e8dbb046f78e3c140f98a8bb24, be8f27f1f6454e8884ca5b580caecefd; no voters:
I20260810 04:54:54.464011 11005 raft_consensus.cc:2781] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:54:54.464134 11005 raft_consensus.cc:482] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:54:54.464172 11005 raft_consensus.cc:3037] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:54.464861 11007 raft_consensus.cc:504] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.465035 10696 raft_consensus.cc:2379] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be8f27f1f6454e8884ca5b580caecefd in current term 1: Already voted for candidate c7cc73525e454382be396a25886319e8 in this term.
I20260810 04:54:54.465065 11007 leader_election.cc:288] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [CANDIDATE]: Term 1 election: Requested vote from peers 945825e8dbb046f78e3c140f98a8bb24 (127.15.239.195:33055), be8f27f1f6454e8884ca5b580caecefd (127.15.239.193:34235)
I20260810 04:54:54.465313 10495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "c7cc73525e454382be396a25886319e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8f27f1f6454e8884ca5b580caecefd"
I20260810 04:54:54.465368 11005 raft_consensus.cc:504] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.465448 10495 raft_consensus.cc:2379] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7cc73525e454382be396a25886319e8 in current term 1: Already voted for candidate be8f27f1f6454e8884ca5b580caecefd in this term.
I20260810 04:54:54.465497 11005 leader_election.cc:288] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [CANDIDATE]: Term 1 election: Requested vote from peers 945825e8dbb046f78e3c140f98a8bb24 (127.15.239.195:33055), c7cc73525e454382be396a25886319e8 (127.15.239.194:42195)
I20260810 04:54:54.465709 10891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "be8f27f1f6454e8884ca5b580caecefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "945825e8dbb046f78e3c140f98a8bb24"
I20260810 04:54:54.465862 10696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "be8f27f1f6454e8884ca5b580caecefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7cc73525e454382be396a25886319e8"
I20260810 04:54:54.465799 10894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4397174c20854ee383a0a0af91b34b57" candidate_uuid: "c7cc73525e454382be396a25886319e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "945825e8dbb046f78e3c140f98a8bb24"
I20260810 04:54:54.465801 10891 raft_consensus.cc:3037] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:54.465966 10696 raft_consensus.cc:2379] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be8f27f1f6454e8884ca5b580caecefd in current term 1: Already voted for candidate c7cc73525e454382be396a25886319e8 in this term.
I20260810 04:54:54.466266 10594 leader_election.cc:302] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7cc73525e454382be396a25886319e8; no voters: 945825e8dbb046f78e3c140f98a8bb24, be8f27f1f6454e8884ca5b580caecefd
I20260810 04:54:54.466918 10891 raft_consensus.cc:2454] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be8f27f1f6454e8884ca5b580caecefd in term 1.
I20260810 04:54:54.467106 10376 leader_election.cc:302] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 945825e8dbb046f78e3c140f98a8bb24, be8f27f1f6454e8884ca5b580caecefd; no voters: c7cc73525e454382be396a25886319e8
I20260810 04:54:54.467196 11007 raft_consensus.cc:2726] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 04:54:54.467271 11005 raft_consensus.cc:2781] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:54.467547 11005 raft_consensus.cc:686] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 1 LEADER]: Becoming Leader. State: Replica: be8f27f1f6454e8884ca5b580caecefd, State: Running, Role: LEADER
I20260810 04:54:54.467664 11005 consensus_queue.cc:237] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } }
I20260810 04:54:54.468760 10260 catalog_manager.cc:5495] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd reported cstate change: term changed from 0 to 1, leader changed from <none> to be8f27f1f6454e8884ca5b580caecefd (127.15.239.193). New cstate: current_term: 1 leader_uuid: "be8f27f1f6454e8884ca5b580caecefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be8f27f1f6454e8884ca5b580caecefd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 34235 } health_report { overall_health: HEALTHY } } }
W20260810 04:54:54.473902 10563 tablet.cc:2369] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:54:54.491783 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.488860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.15.239.193:34235)
0810 04:54:54.488936 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.488939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.488992 (+ 53us) server_negotiation.cc:407] Connection header received
0810 04:54:54.489118 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.489121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.489151 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.489243 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:54:54.489410 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.489958 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.490832 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.491056 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.491144 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.491327 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:54:54.491480 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:54:54.491592 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.491610 (+ 18us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.491635 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 04:54:54.494356 10696 raft_consensus.cc:1261] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Refusing update from remote peer be8f27f1f6454e8884ca5b580caecefd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:54.494356 10891 raft_consensus.cc:1261] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 1 FOLLOWER]: Refusing update from remote peer be8f27f1f6454e8884ca5b580caecefd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:54.494719 11005 consensus_queue.cc:1035] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [LEADER]: Connected to new peer: Peer: permanent_uuid: "945825e8dbb046f78e3c140f98a8bb24" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:54.494911 11011 consensus_queue.cc:1035] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7cc73525e454382be396a25886319e8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:54.498708 11016 mvcc.cc:205] Tried to move back new op lower bound from 7316839196645085184 to 7316839196540465152. Current Snapshot: MvccSnapshot[applied={T|T < 7316839196645085184}]
I20260810 04:54:54.498852 11017 mvcc.cc:205] Tried to move back new op lower bound from 7316839196645085184 to 7316839196540465152. Current Snapshot: MvccSnapshot[applied={T|T < 7316839196645085184}]
I20260810 04:54:54.499006 11018 mvcc.cc:205] Tried to move back new op lower bound from 7316839196645085184 to 7316839196540465152. Current Snapshot: MvccSnapshot[applied={T|T < 7316839196645085184 or (T in {7316839196645085184})}]
I20260810 04:54:54.502127 10260 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:54.502290 10260 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:54.503279 10260 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 36333494363644a58d365ad36ff579c7: Sending DeleteTablet for 3 replicas of tablet 4397174c20854ee383a0a0af91b34b57
I20260810 04:54:54.503733 10457 tablet_service.cc:1514] Processing DeleteTablet for tablet 4397174c20854ee383a0a0af91b34b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:54 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:50332
I20260810 04:54:54.503703 10665 tablet_service.cc:1514] Processing DeleteTablet for tablet 4397174c20854ee383a0a0af91b34b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:54 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:46186
I20260810 04:54:54.503710 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 4397174c20854ee383a0a0af91b34b57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:54 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:35100
I20260810 04:54:54.503995 11029 tablet_replica.cc:330] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: stopping tablet replica
I20260810 04:54:54.504053 11030 tablet_replica.cc:330] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: stopping tablet replica
I20260810 04:54:54.504177 11030 raft_consensus.cc:2229] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:54.504241 11031 tablet_replica.cc:330] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd: stopping tablet replica
I20260810 04:54:54.504281 11029 raft_consensus.cc:2229] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:54.504341 11030 raft_consensus.cc:2258] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:54.504401 11031 raft_consensus.cc:2229] T 4397174c20854ee383a0a0af91b34b57 P be8f27f1f6454e8884ca5b580caecefd [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:54:54.504467 11029 raft_consensus.cc:2258] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:54.504469 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 10355
I20260810 04:54:54.508736 11030 ts_tablet_manager.cc:1905] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:54.510721 11030 ts_tablet_manager.cc:1918] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:54.510797 11030 log.cc:1196] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/4397174c20854ee383a0a0af91b34b57
I20260810 04:54:54.511528 11030 ts_tablet_manager.cc:1939] T 4397174c20854ee383a0a0af91b34b57 P c7cc73525e454382be396a25886319e8: Deleting consensus metadata
I20260810 04:54:54.512001 10240 catalog_manager.cc:4841] TS c7cc73525e454382be396a25886319e8 (127.15.239.194:42195): tablet 4397174c20854ee383a0a0af91b34b57 (table test-table [id=d492910b67df42f2a8d144bf72e44181]) successfully deleted
I20260810 04:54:54.518898 11029 ts_tablet_manager.cc:1905] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:54.521867 11029 ts_tablet_manager.cc:1918] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:54.521999 11029 log.cc:1196] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/4397174c20854ee383a0a0af91b34b57
I20260810 04:54:54.522796 11029 ts_tablet_manager.cc:1939] T 4397174c20854ee383a0a0af91b34b57 P 945825e8dbb046f78e3c140f98a8bb24: Deleting consensus metadata
I20260810 04:54:54.523515 10239 catalog_manager.cc:4841] TS 945825e8dbb046f78e3c140f98a8bb24 (127.15.239.195:33055): tablet 4397174c20854ee383a0a0af91b34b57 (table test-table [id=d492910b67df42f2a8d144bf72e44181]) successfully deleted
W20260810 04:54:54.532508 10239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:34235 (error 108)
I20260810 04:54:54.532797 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 10571
I20260810 04:54:54.538156 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.537958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:34235 (local address 127.0.0.1:50336)
0810 04:54:54.538032 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.538093 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:34235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 04:54:54.538964 10239 catalog_manager.cc:4584] TS be8f27f1f6454e8884ca5b580caecefd (127.15.239.193:34235): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4397174c20854ee383a0a0af91b34b57: Network error: Client connection negotiation failed: client connection to 127.15.239.193:34235: connect: Connection refused (error 111)
I20260810 04:54:54.547178 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 10766
I20260810 04:54:54.561111 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 10216
2026-08-10T04:54:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2401 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T04:54:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:54:54Z Disabled control of system clock
I20260810 04:54:54.607352 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39991
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:44025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:39991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:54:54.703904 11037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:54.704216 11037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:54.704238 11037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:54.705513 11037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:54:54.705564 11037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:54.705576 11037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:54.705590 11037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:54:54.705601 11037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:54:54.707060 11037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:39991
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:54.707376 11037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:54.707765 11037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:54.713496 11050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.713510 11044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.713511 11045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:54.713775 11037 server_base.cc:1034] running on GCE node
I20260810 04:54:54.714067 11037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:54.714447 11037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:54.715627 11037 hybrid_clock.cc:648] HybridClock initialized: now 1786337694715616 us; error 34 us; skew 500 ppm
I20260810 04:54:54.717242 11037 webserver.cc:460] Webserver started at http://127.15.239.254:36679/ using document root <none> and password file <none>
I20260810 04:54:54.717542 11037 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:54.717621 11037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:54.717794 11037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:54.719033 11037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "960ac0748b8842ad8abf6657f8c0c2dc"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "d5e483d2f8e6616d9d7f16cc6afca389"
server_key_iv: "6219ac6688a2c9d8a4a92d12e0adeb16"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.719450 11037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "960ac0748b8842ad8abf6657f8c0c2dc"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "d5e483d2f8e6616d9d7f16cc6afca389"
server_key_iv: "6219ac6688a2c9d8a4a92d12e0adeb16"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.721020 11037 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:54:54.721932 11060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.722155 11037 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:54.722278 11037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "960ac0748b8842ad8abf6657f8c0c2dc"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "d5e483d2f8e6616d9d7f16cc6afca389"
server_key_iv: "6219ac6688a2c9d8a4a92d12e0adeb16"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.722363 11037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:54.737028 11037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:54.737433 11037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:54.737615 11037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:54.742759 11037 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:39991
I20260810 04:54:54.742794 11140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:39991 every 8 connection(s)
I20260810 04:54:54.743224 11037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:54:54.744520 11141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:54.747323 11141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc: Bootstrap starting.
I20260810 04:54:54.748106 11141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:54.748474 11141 log.cc:824] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:54.749312 11141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc: No bootstrap required, opened a new log
I20260810 04:54:54.751129 11141 raft_consensus.cc:348] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39991 } }
I20260810 04:54:54.751293 11141 raft_consensus.cc:374] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:54.751319 11141 raft_consensus.cc:729] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960ac0748b8842ad8abf6657f8c0c2dc, State: Initialized, Role: FOLLOWER
I20260810 04:54:54.751513 11141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39991 } }
I20260810 04:54:54.751586 11141 raft_consensus.cc:388] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:54:54.751611 11141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:54:54.751681 11141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:54.752367 11141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39991 } }
I20260810 04:54:54.752501 11141 leader_election.cc:302] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 960ac0748b8842ad8abf6657f8c0c2dc; no voters:
I20260810 04:54:54.752710 11141 leader_election.cc:288] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:54:54.752771 11147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:54.753057 11147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [term 1 LEADER]: Becoming Leader. State: Replica: 960ac0748b8842ad8abf6657f8c0c2dc, State: Running, Role: LEADER
I20260810 04:54:54.753069 11141 sys_catalog.cc:564] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:54:54.753237 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 11037
I20260810 04:54:54.753278 11147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39991 } }
I20260810 04:54:54.753331 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:54:54.753600 16319 external_mini_cluster.cc:1428] Setting key ffcea9f8d2cc4b47b7553ce640d689a3
I20260810 04:54:54.753932 11150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 960ac0748b8842ad8abf6657f8c0c2dc. Latest consensus state: current_term: 1 leader_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39991 } } }
I20260810 04:54:54.754030 11150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:54.754590 11149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "960ac0748b8842ad8abf6657f8c0c2dc" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39991 } } }
I20260810 04:54:54.754624 11160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:54:54.754693 11149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:54.755277 11160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:54:54.757197 11160 catalog_manager.cc:1347] Generated new cluster ID: 384cbc6ff05b4ccab6ad84d4e48d6520
I20260810 04:54:54.757261 11160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:54:54.760923 11161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.754489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39564 (local address 127.15.239.254:39991)
0810 04:54:54.754746 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.754757 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.754792 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:54:54.754935 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.754944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.755034 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.755515 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:54.755704 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.757089 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.758333 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.758980 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.759101 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.759978 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:54.759983 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:54.759983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:54.760252 (+ 269us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:54.760299 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:54.760315 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:54.760388 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.760492 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.760585 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
I20260810 04:54:54.765642 11160 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:54:54.766444 11160 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:54:54.771265 11160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc: Generated new TSK 0
I20260810 04:54:54.771499 11160 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:54:54.776953 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39991
--builtin_ntp_servers=127.15.239.212:44025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:54:54.876351 11179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:54.876612 11179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:54.876637 11179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:54.877893 11179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:54.877938 11179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:54.877969 11179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:54:54.879416 11179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:54.879737 11179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:54.880201 11179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:54.886404 11185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:54.886350 11193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:54.886723 11179 server_base.cc:1034] running on GCE node
W20260810 04:54:54.886749 11190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:54.887023 11179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:54.887322 11179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:54.888492 11179 hybrid_clock.cc:648] HybridClock initialized: now 1786337694888448 us; error 55 us; skew 500 ppm
I20260810 04:54:54.890250 11179 webserver.cc:460] Webserver started at http://127.15.239.193:46087/ using document root <none> and password file <none>
I20260810 04:54:54.890586 11179 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:54.890650 11179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:54.890805 11179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:54.892622 11179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "1c5405f5215e45598047233c2edfc135"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "80b2bc4854030f2135b97654b5bccf4e"
server_key_iv: "7f88747cbf7fbb565b1fd22b7c78bdd9"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.893149 11179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "1c5405f5215e45598047233c2edfc135"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "80b2bc4854030f2135b97654b5bccf4e"
server_key_iv: "7f88747cbf7fbb565b1fd22b7c78bdd9"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.894995 11179 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260810 04:54:54.896091 11200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.896322 11179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:54.896433 11179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "1c5405f5215e45598047233c2edfc135"
format_stamp: "Formatted at 2026-08-10 04:54:54 on dist-test-slave-kvfs"
server_key: "80b2bc4854030f2135b97654b5bccf4e"
server_key_iv: "7f88747cbf7fbb565b1fd22b7c78bdd9"
server_key_version: "encryptionkey@0"
I20260810 04:54:54.896521 11179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:54.909289 11179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:54.909750 11179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:54.909953 11179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:54.910246 11179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:54.910663 11179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:54.910701 11179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.910728 11179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:54.910772 11179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:54.918044 11179 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:45979
I20260810 04:54:54.918119 11382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:45979 every 8 connection(s)
I20260810 04:54:54.918533 11179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:54:54.925060 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 11179
I20260810 04:54:54.925189 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:54:54.925205 11161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.919553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:37879 (local address 127.15.239.254:39991)
0810 04:54:54.919627 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:54.919629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:54.919914 (+ 285us) server_negotiation.cc:407] Connection header received
0810 04:54:54.920592 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:54.920594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:54.920612 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:54.920686 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:54.921492 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.922080 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.923346 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.923621 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.923696 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.924809 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:54.924811 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:54.924811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:54.924818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:54.924842 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:54.924848 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:54.924915 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:54.925036 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 04:54:54.925090 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:54:54.925451 16319 external_mini_cluster.cc:1428] Setting key aa9896627e29250b1f935c7e9f96e564
I20260810 04:54:54.925566 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:54.919522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39991 (local address 127.15.239.193:37879)
0810 04:54:54.919761 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:54.919810 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:54.920477 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:54.920753 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:54.920757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:54.920766 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:54.921380 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.921385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.922231 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.922232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.923216 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:54.923219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:54.923740 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:54.923741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:54.923891 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:54.924636 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:54:54.924637 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:54.924672 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:54:54.924700 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:54.924933 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:54.924939 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:54.924942 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:54:54.925013 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 04:54:54.925122 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":123,"threads_started":1}
I20260810 04:54:54.926206 11384 heartbeater.cc:347] Connected to a master server at 127.15.239.254:39991
I20260810 04:54:54.926334 11384 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:54.926590 11384 heartbeater.cc:511] Master 127.15.239.254:39991 requested a full tablet report, sending...
I20260810 04:54:54.926743 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39991
--builtin_ntp_servers=127.15.239.212:44025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 04:54:54.927376 11090 ts_manager.cc:194] Registered new tserver with Master: 1c5405f5215e45598047233c2edfc135 (127.15.239.193:45979)
I20260810 04:54:54.928439 11090 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.193:37879
W20260810 04:54:55.025804 11388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:55.026106 11388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:55.026130 11388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:55.027408 11388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:55.027458 11388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:55.027503 11388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:54:55.028908 11388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:55.029137 11388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:55.029441 11388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:55.035279 11399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:55.035307 11403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:55.035591 11388 server_base.cc:1034] running on GCE node
W20260810 04:54:55.035650 11398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:55.035910 11388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:55.036257 11388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:55.037424 11388 hybrid_clock.cc:648] HybridClock initialized: now 1786337695037386 us; error 52 us; skew 500 ppm
I20260810 04:54:55.039052 11388 webserver.cc:460] Webserver started at http://127.15.239.194:46067/ using document root <none> and password file <none>
I20260810 04:54:55.039343 11388 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:55.039395 11388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:55.039602 11388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:55.041215 11388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "3f4606886a7e43ca901a58098ae664a4"
format_stamp: "Formatted at 2026-08-10 04:54:55 on dist-test-slave-kvfs"
server_key: "10c9b05fd42e9f61e2653b9ed57f700c"
server_key_iv: "5de319b64fdf7f8288c579eabd75afdd"
server_key_version: "encryptionkey@0"
I20260810 04:54:55.041728 11388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "3f4606886a7e43ca901a58098ae664a4"
format_stamp: "Formatted at 2026-08-10 04:54:55 on dist-test-slave-kvfs"
server_key: "10c9b05fd42e9f61e2653b9ed57f700c"
server_key_iv: "5de319b64fdf7f8288c579eabd75afdd"
server_key_version: "encryptionkey@0"
I20260810 04:54:55.043558 11388 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260810 04:54:55.045229 11410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:55.045421 11388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:54:55.045526 11388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "3f4606886a7e43ca901a58098ae664a4"
format_stamp: "Formatted at 2026-08-10 04:54:55 on dist-test-slave-kvfs"
server_key: "10c9b05fd42e9f61e2653b9ed57f700c"
server_key_iv: "5de319b64fdf7f8288c579eabd75afdd"
server_key_version: "encryptionkey@0"
I20260810 04:54:55.045591 11388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:55.058303 11388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:55.058609 11388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:55.058717 11388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:55.058929 11388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:55.059266 11388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:55.059300 11388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:55.059324 11388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:55.059343 11388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:55.066448 11388 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:35637
I20260810 04:54:55.066507 11578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:35637 every 8 connection(s)
I20260810 04:54:55.066876 11388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:54:55.072499 11161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.067770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:55161 (local address 127.15.239.254:39991)
0810 04:54:55.067844 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.067846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.068136 (+ 290us) server_negotiation.cc:407] Connection header received
0810 04:54:55.068708 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.068709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.068723 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.068774 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:55.069504 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.070052 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.071075 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.071268 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.071320 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.072230 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:55.072232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:55.072232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:55.072236 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:55.072256 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:55.072261 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:55.072307 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.072394 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.072424 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:54:55.072757 11584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.067744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39991 (local address 127.15.239.194:55161)
0810 04:54:55.067975 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.068014 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.068609 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.068846 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.068850 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.068860 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:55.069432 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.069436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.070137 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.070138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.070997 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.070999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.071343 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.071344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.071466 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.072075 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:54:55.072076 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:55.072122 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:54:55.072150 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:55.072319 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:55.072325 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:55.072327 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.072387 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.072482 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260810 04:54:55.073364 11579 heartbeater.cc:347] Connected to a master server at 127.15.239.254:39991
I20260810 04:54:55.073535 11579 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:55.073766 11579 heartbeater.cc:511] Master 127.15.239.254:39991 requested a full tablet report, sending...
I20260810 04:54:55.074265 11090 ts_manager.cc:194] Registered new tserver with Master: 3f4606886a7e43ca901a58098ae664a4 (127.15.239.194:35637)
I20260810 04:54:55.074690 11090 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.194:55161
I20260810 04:54:55.075047 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 11388
I20260810 04:54:55.075162 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:54:55.075399 16319 external_mini_cluster.cc:1428] Setting key 3ae39a75fe04b54bc84f11b4ff555a26
I20260810 04:54:55.076411 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39991
--builtin_ntp_servers=127.15.239.212:44025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:54:55.172701 11585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:55.172984 11585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:55.173009 11585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:55.174256 11585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:55.174304 11585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:55.174331 11585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:54:55.175791 11585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:44025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:55.176136 11585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:55.176524 11585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:55.182554 11597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:55.182555 11594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:55.182621 11595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:55.182672 11585 server_base.cc:1034] running on GCE node
I20260810 04:54:55.183063 11585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:55.183358 11585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:55.184657 11585 hybrid_clock.cc:648] HybridClock initialized: now 1786337695184646 us; error 35 us; skew 500 ppm
I20260810 04:54:55.186391 11585 webserver.cc:460] Webserver started at http://127.15.239.195:43983/ using document root <none> and password file <none>
I20260810 04:54:55.186717 11585 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:55.186772 11585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:55.186968 11585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:55.188328 11585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "88f8a46b9a774ab7b30345a04045542d"
format_stamp: "Formatted at 2026-08-10 04:54:55 on dist-test-slave-kvfs"
server_key: "0acbf894de965a9cf815105c4a09ddbc"
server_key_iv: "5cabb7d92b8895d887c2db799821d202"
server_key_version: "encryptionkey@0"
I20260810 04:54:55.188726 11585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "88f8a46b9a774ab7b30345a04045542d"
format_stamp: "Formatted at 2026-08-10 04:54:55 on dist-test-slave-kvfs"
server_key: "0acbf894de965a9cf815105c4a09ddbc"
server_key_iv: "5cabb7d92b8895d887c2db799821d202"
server_key_version: "encryptionkey@0"
I20260810 04:54:55.190253 11585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:54:55.191078 11604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:55.191286 11585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:55.191408 11585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "88f8a46b9a774ab7b30345a04045542d"
format_stamp: "Formatted at 2026-08-10 04:54:55 on dist-test-slave-kvfs"
server_key: "0acbf894de965a9cf815105c4a09ddbc"
server_key_iv: "5cabb7d92b8895d887c2db799821d202"
server_key_version: "encryptionkey@0"
I20260810 04:54:55.191490 11585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:55.202909 11585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:55.203331 11585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:55.203553 11585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:55.203822 11585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:55.204311 11585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:55.204367 11585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:55.204406 11585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:55.204438 11585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:55.212742 11585 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:36551
I20260810 04:54:55.212783 11771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:36551 every 8 connection(s)
I20260810 04:54:55.213261 11585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:54:55.213804 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 11585
I20260810 04:54:55.213937 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:54:55.214211 16319 external_mini_cluster.cc:1428] Setting key 20e1d2bef4bc70b6d23f3a766023f796
I20260810 04:54:55.219957 11161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.214286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:46881 (local address 127.15.239.254:39991)
0810 04:54:55.214356 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.214358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.214668 (+ 310us) server_negotiation.cc:407] Connection header received
0810 04:54:55.215454 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.215455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.215471 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.215512 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:55.216518 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.217104 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.218236 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.218466 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.218556 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.219595 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:55.219597 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:55.219597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:55.219603 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:55.219627 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:55.219632 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:55.219692 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.219818 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.219857 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:54:55.220218 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.214275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39991 (local address 127.15.239.195:46881)
0810 04:54:55.214518 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.214576 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.215342 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.215615 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.215625 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.215635 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:55.216425 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.216431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.217205 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.217206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.218125 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.218128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.218567 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.218568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.218740 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.219420 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:54:55.219421 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:55.219456 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:54:55.219484 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:55.219694 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:55.219701 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:55.219705 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.219782 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.219913 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":107,"threads_started":1}
I20260810 04:54:55.220760 11772 heartbeater.cc:347] Connected to a master server at 127.15.239.254:39991
I20260810 04:54:55.220858 11772 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:55.221100 11772 heartbeater.cc:511] Master 127.15.239.254:39991 requested a full tablet report, sending...
I20260810 04:54:55.221534 11090 ts_manager.cc:194] Registered new tserver with Master: 88f8a46b9a774ab7b30345a04045542d (127.15.239.195:36551)
I20260810 04:54:55.222040 11090 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.195:46881
I20260810 04:54:55.226550 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:54:55.231637 11161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.228272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39570 (local address 127.15.239.254:39991)
0810 04:54:55.228359 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.228362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.228498 (+ 136us) server_negotiation.cc:407] Connection header received
0810 04:54:55.228576 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.228577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.228594 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.228654 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:55.228844 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.229374 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.230220 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.230449 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.230524 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.231352 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:55.231354 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:55.231354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:55.231360 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:55.231379 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:55.231383 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:55.231450 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.231504 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.231538 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:54:55.233484 11090 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:54:55.235359 11090 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:54:55.243005 11783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.238033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:36551 (local address 127.0.0.1:53334)
0810 04:54:55.238440 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.238496 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.238571 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.238811 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.238815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.238818 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:55.238909 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.238911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.240099 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.240101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.241363 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.241366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.242547 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.242548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.242651 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.242671 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.242727 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.242794 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":93,"threads_started":1}
I20260810 04:54:55.243419 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.238302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:35637 (local address 127.0.0.1:58894)
0810 04:54:55.238690 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.238698 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.238740 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.239101 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.239102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.239105 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:55.239161 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.239162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.240564 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.240565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.241714 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.241717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.243100 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.243101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.243190 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.243195 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.243251 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.243295 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":90,"threads_started":1}
I20260810 04:54:55.243893 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.238266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.15.239.195:36551)
0810 04:54:55.238552 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.238559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.238573 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:54:55.238665 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.238667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.238687 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.238998 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:55.239102 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.239964 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.241467 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.242431 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.243553 (+ 1122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.243693 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.243725 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.243780 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":134,"threads_started":1}
I20260810 04:54:55.244253 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.238043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:45979 (local address 127.0.0.1:51498)
0810 04:54:55.238440 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.238489 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.238571 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.239087 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.239088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.239091 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:55.239148 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.239149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.241846 (+ 2697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.241846 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.242949 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.242952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.243978 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.243979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.244086 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.244090 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.244121 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.244162 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":90,"threads_started":1}
I20260810 04:54:55.244688 11785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.238179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.15.239.193:45979)
0810 04:54:55.238894 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.238900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.238911 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:54:55.238961 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.238963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.238980 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.239075 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:55.239224 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.240447 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.243063 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.243881 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.244384 (+ 503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.244514 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.244543 (+ 29us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.244590 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":117,"threads_started":1}
I20260810 04:54:55.244813 11677 tablet_service.cc:1467] Processing CreateTablet for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 (DEFAULT_TABLE table=test-table [id=21385fb73f8f4d0a8556656d3feb55db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:55.245168 11789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.238467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58894 (local address 127.15.239.194:35637)
0810 04:54:55.238893 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.238900 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.238911 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:54:55.238961 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.238963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.238989 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.239247 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:55.239337 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.240474 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.241841 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.242981 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.244263 (+ 1282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.244966 (+ 703us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.244996 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.245060 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":105,"threads_started":1}
I20260810 04:54:55.245352 11677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:55.245915 11480 tablet_service.cc:1467] Processing CreateTablet for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 (DEFAULT_TABLE table=test-table [id=21385fb73f8f4d0a8556656d3feb55db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:55.246325 11480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:55.247452 11281 tablet_service.cc:1467] Processing CreateTablet for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 (DEFAULT_TABLE table=test-table [id=21385fb73f8f4d0a8556656d3feb55db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:55.247910 11281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:55.250250 11790 tablet_bootstrap.cc:492] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Bootstrap starting.
I20260810 04:54:55.250653 11791 tablet_bootstrap.cc:492] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Bootstrap starting.
I20260810 04:54:55.251475 11790 tablet_bootstrap.cc:654] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:55.251493 11791 tablet_bootstrap.cc:654] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:55.251837 11790 log.cc:824] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:55.251866 11791 log.cc:824] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:55.253362 11791 tablet_bootstrap.cc:492] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: No bootstrap required, opened a new log
I20260810 04:54:55.253479 11791 ts_tablet_manager.cc:1397] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:54:55.253592 11798 tablet_bootstrap.cc:492] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: Bootstrap starting.
I20260810 04:54:55.254848 11798 tablet_bootstrap.cc:654] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:55.254918 11790 tablet_bootstrap.cc:492] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: No bootstrap required, opened a new log
I20260810 04:54:55.254993 11790 ts_tablet_manager.cc:1397] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260810 04:54:55.255366 11798 log.cc:824] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:55.256328 11798 tablet_bootstrap.cc:492] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: No bootstrap required, opened a new log
I20260810 04:54:55.256454 11798 ts_tablet_manager.cc:1397] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:54:55.257066 11791 raft_consensus.cc:348] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.257230 11791 raft_consensus.cc:374] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:55.257256 11791 raft_consensus.cc:729] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f4606886a7e43ca901a58098ae664a4, State: Initialized, Role: FOLLOWER
I20260810 04:54:55.257393 11791 consensus_queue.cc:260] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.257695 11791 ts_tablet_manager.cc:1428] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260810 04:54:55.257714 11579 heartbeater.cc:503] Master 127.15.239.254:39991 was elected leader, sending a full tablet report...
I20260810 04:54:55.258000 11790 raft_consensus.cc:348] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.258174 11790 raft_consensus.cc:374] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:55.258220 11790 raft_consensus.cc:729] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f8a46b9a774ab7b30345a04045542d, State: Initialized, Role: FOLLOWER
I20260810 04:54:55.258370 11790 consensus_queue.cc:260] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.258692 11790 ts_tablet_manager.cc:1428] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260810 04:54:55.258744 11772 heartbeater.cc:503] Master 127.15.239.254:39991 was elected leader, sending a full tablet report...
I20260810 04:54:55.259630 11798 raft_consensus.cc:348] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.259809 11798 raft_consensus.cc:374] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:55.259884 11798 raft_consensus.cc:729] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5405f5215e45598047233c2edfc135, State: Initialized, Role: FOLLOWER
I20260810 04:54:55.260002 11798 consensus_queue.cc:260] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.260355 11798 ts_tablet_manager.cc:1428] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260810 04:54:55.260397 11384 heartbeater.cc:503] Master 127.15.239.254:39991 was elected leader, sending a full tablet report...
W20260810 04:54:55.317589 11581 tablet.cc:2369] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:54:55.360707 11806 raft_consensus.cc:482] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:55.360905 11806 raft_consensus.cc:504] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.361384 11806 leader_election.cc:288] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88f8a46b9a774ab7b30345a04045542d (127.15.239.195:36551), 3f4606886a7e43ca901a58098ae664a4 (127.15.239.194:35637)
I20260810 04:54:55.364676 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.361597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:36551 (local address 127.15.239.193:41423)
0810 04:54:55.361682 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.361701 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.361767 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.361983 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.361985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.361986 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:55.362082 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.362085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.362923 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.362924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.363798 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.363801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.364387 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.364388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.364469 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.364474 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.364530 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.364582 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":6}
I20260810 04:54:55.364693 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.361702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:41423 (local address 127.15.239.195:36551)
0810 04:54:55.361786 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.361790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.361801 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:54:55.361855 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.361856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.361871 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.361934 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:55.362177 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.362831 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.363898 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.364304 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.364364 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.364372 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.364548 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.364591 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 04:54:55.364801 11807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.361756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:35637 (local address 127.15.239.193:53999)
0810 04:54:55.362020 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.362030 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:55.362091 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:55.362251 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:55.362252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:55.362253 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:55.362330 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.362332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.363058 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.363060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.363814 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:55.363816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.364503 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.364521 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:55.364608 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.364612 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:55.364671 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 04:54:55.364713 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":162,"threads_started":1}
I20260810 04:54:55.364850 11789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.361961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:53999 (local address 127.15.239.194:35637)
0810 04:54:55.362029 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.362031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.362087 (+ 56us) server_negotiation.cc:407] Connection header received
0810 04:54:55.362160 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.362161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.362174 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.362228 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:55.362409 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.362970 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.363941 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.364412 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.364491 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.364501 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.364695 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.364748 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 04:54:55.365052 11709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda9e9c6b5b4ba4840dcf53b7d44f86" candidate_uuid: "1c5405f5215e45598047233c2edfc135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f8a46b9a774ab7b30345a04045542d" is_pre_election: true
I20260810 04:54:55.365247 11709 raft_consensus.cc:2454] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5405f5215e45598047233c2edfc135 in term 0.
I20260810 04:54:55.365432 11513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda9e9c6b5b4ba4840dcf53b7d44f86" candidate_uuid: "1c5405f5215e45598047233c2edfc135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f4606886a7e43ca901a58098ae664a4" is_pre_election: true
I20260810 04:54:55.365522 11210 leader_election.cc:302] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5405f5215e45598047233c2edfc135, 88f8a46b9a774ab7b30345a04045542d; no voters:
I20260810 04:54:55.365613 11513 raft_consensus.cc:2454] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c5405f5215e45598047233c2edfc135 in term 0.
I20260810 04:54:55.365734 11806 raft_consensus.cc:2781] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:54:55.365801 11806 raft_consensus.cc:482] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:54:55.365818 11806 raft_consensus.cc:3037] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:55.366720 11806 raft_consensus.cc:504] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.366897 11806 leader_election.cc:288] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [CANDIDATE]: Term 1 election: Requested vote from peers 88f8a46b9a774ab7b30345a04045542d (127.15.239.195:36551), 3f4606886a7e43ca901a58098ae664a4 (127.15.239.194:35637)
I20260810 04:54:55.367072 11709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda9e9c6b5b4ba4840dcf53b7d44f86" candidate_uuid: "1c5405f5215e45598047233c2edfc135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f8a46b9a774ab7b30345a04045542d"
I20260810 04:54:55.367118 11513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dda9e9c6b5b4ba4840dcf53b7d44f86" candidate_uuid: "1c5405f5215e45598047233c2edfc135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f4606886a7e43ca901a58098ae664a4"
I20260810 04:54:55.367170 11709 raft_consensus.cc:3037] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:55.367200 11513 raft_consensus.cc:3037] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:55.368335 11709 raft_consensus.cc:2454] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5405f5215e45598047233c2edfc135 in term 1.
I20260810 04:54:55.368335 11513 raft_consensus.cc:2454] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c5405f5215e45598047233c2edfc135 in term 1.
I20260810 04:54:55.368546 11210 leader_election.cc:302] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c5405f5215e45598047233c2edfc135, 88f8a46b9a774ab7b30345a04045542d; no voters:
I20260810 04:54:55.368669 11806 raft_consensus.cc:2781] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:55.368853 11806 raft_consensus.cc:686] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5405f5215e45598047233c2edfc135, State: Running, Role: LEADER
I20260810 04:54:55.368993 11806 consensus_queue.cc:237] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } }
I20260810 04:54:55.370133 11090 catalog_manager.cc:5495] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c5405f5215e45598047233c2edfc135 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "1c5405f5215e45598047233c2edfc135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c5405f5215e45598047233c2edfc135" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 } health_report { overall_health: UNKNOWN } } }
I20260810 04:54:55.393766 11785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.391031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.15.239.193:45979)
0810 04:54:55.391115 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:55.391117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:55.391125 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:54:55.391181 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:55.391182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:55.391209 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:55.391296 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:54:55.391472 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.392007 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.392845 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:55.393065 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:55.393157 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:55.393336 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:54:55.393479 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:54:55.393582 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:55.393602 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 04:54:55.393625 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 04:54:55.396375 11709 raft_consensus.cc:1261] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 1 FOLLOWER]: Refusing update from remote peer 1c5405f5215e45598047233c2edfc135: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:55.396376 11513 raft_consensus.cc:1261] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 1 FOLLOWER]: Refusing update from remote peer 1c5405f5215e45598047233c2edfc135: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:55.396832 11806 consensus_queue.cc:1035] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f8a46b9a774ab7b30345a04045542d" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 36551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:55.397032 11808 consensus_queue.cc:1035] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f4606886a7e43ca901a58098ae664a4" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 35637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:55.400367 11814 mvcc.cc:205] Tried to move back new op lower bound from 7316839200339677184 to 7316839200232226816. Current Snapshot: MvccSnapshot[applied={T|T < 7316839200339677184}]
I20260810 04:54:55.403898 11087 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:55.404028 11087 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:55.405016 11087 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 960ac0748b8842ad8abf6657f8c0c2dc: Sending DeleteTablet for 3 replicas of tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86
I20260810 04:54:55.405470 11281 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:55 UTC) from {username='slave'} at 127.0.0.1:51498
I20260810 04:54:55.405463 11677 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:55 UTC) from {username='slave'} at 127.0.0.1:53334
I20260810 04:54:55.405527 11480 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:55 UTC) from {username='slave'} at 127.0.0.1:58894
I20260810 04:54:55.405731 11835 tablet_replica.cc:330] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135: stopping tablet replica
I20260810 04:54:55.405869 11835 raft_consensus.cc:2229] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:54:55.406016 11835 raft_consensus.cc:2258] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 1c5405f5215e45598047233c2edfc135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:55.406104 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 11179
I20260810 04:54:55.415975 11839 tablet_replica.cc:330] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: stopping tablet replica
I20260810 04:54:55.416204 11839 raft_consensus.cc:2229] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:55.416402 11839 raft_consensus.cc:2258] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:55.416602 11838 tablet_replica.cc:330] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: stopping tablet replica
I20260810 04:54:55.416716 11838 raft_consensus.cc:2229] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:55.416812 11838 raft_consensus.cc:2258] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:55.417717 11839 ts_tablet_manager.cc:1905] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:55.417801 11838 ts_tablet_manager.cc:1905] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:55.419672 11839 ts_tablet_manager.cc:1918] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:55.419793 11839 log.cc:1196] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/0dda9e9c6b5b4ba4840dcf53b7d44f86
I20260810 04:54:55.420162 11839 ts_tablet_manager.cc:1939] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 3f4606886a7e43ca901a58098ae664a4: Deleting consensus metadata
I20260810 04:54:55.420485 11838 ts_tablet_manager.cc:1918] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:55.420578 11838 log.cc:1196] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/0dda9e9c6b5b4ba4840dcf53b7d44f86
I20260810 04:54:55.420774 11067 catalog_manager.cc:4841] TS 3f4606886a7e43ca901a58098ae664a4 (127.15.239.194:35637): tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 (table test-table [id=21385fb73f8f4d0a8556656d3feb55db]) successfully deleted
I20260810 04:54:55.420863 11838 ts_tablet_manager.cc:1939] T 0dda9e9c6b5b4ba4840dcf53b7d44f86 P 88f8a46b9a774ab7b30345a04045542d: Deleting consensus metadata
I20260810 04:54:55.421352 11067 catalog_manager.cc:4841] TS 88f8a46b9a774ab7b30345a04045542d (127.15.239.195:36551): tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86 (table test-table [id=21385fb73f8f4d0a8556656d3feb55db]) successfully deleted
W20260810 04:54:55.424568 11065 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:45979 (error 108)
I20260810 04:54:55.424885 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 11388
I20260810 04:54:55.425235 11784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:55.425077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:45979 (local address 127.0.0.1:51514)
0810 04:54:55.425143 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:55.425187 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:45979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 04:54:55.425374 11065 catalog_manager.cc:4584] TS 1c5405f5215e45598047233c2edfc135 (127.15.239.193:45979): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0dda9e9c6b5b4ba4840dcf53b7d44f86: Network error: Client connection negotiation failed: client connection to 127.15.239.193:45979: connect: Connection refused (error 111)
I20260810 04:54:55.438778 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 11585
I20260810 04:54:55.452126 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 11037
2026-08-10T04:54:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (884 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:54:55 dist-test-slave-kvfs krb5kdc[11843](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:54:55 dist-test-slave-kvfs krb5kdc[11843](info): set up 2 sockets
Aug 10 04:54:55 dist-test-slave-kvfs krb5kdc[11843](info): commencing operation
krb5kdc: starting...
W20260810 04:54:56.755505 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:54:56 dist-test-slave-kvfs krb5kdc[11843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:54:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:54:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:54:56.901670 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35783
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:35783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:56.998167 11867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:56.998503 11867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:56.998544 11867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:56.999794 11867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:54:56.999876 11867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:56.999899 11867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:56.999922 11867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:54:56.999948 11867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:54:57.001713 11867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:35783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:57.002081 11867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:57.002385 11867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:57.008496 11874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.008580 11872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.008586 11878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:57.008991 11867 server_base.cc:1034] running on GCE node
I20260810 04:54:57.009291 11867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:57.009639 11867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:57.010802 11867 hybrid_clock.cc:648] HybridClock initialized: now 1786337697010779 us; error 50 us; skew 500 ppm
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:57.013906 11867 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:54:57.014478 11867 webserver.cc:460] Webserver started at http://127.15.239.254:37351/ using document root <none> and password file <none>
I20260810 04:54:57.014721 11867 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:57.014768 11867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:57.014878 11867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:57.016216 11867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "acf994984c2d4733a71013c924420edf"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "b1d827135a29b0fb6d7da30f3e89d6a3"
server_key_iv: "15e28db697122599c383014340462bf9"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.016587 11867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "acf994984c2d4733a71013c924420edf"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "b1d827135a29b0fb6d7da30f3e89d6a3"
server_key_iv: "15e28db697122599c383014340462bf9"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.018177 11867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:54:57.019068 11888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.019289 11867 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:57.019400 11867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "acf994984c2d4733a71013c924420edf"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "b1d827135a29b0fb6d7da30f3e89d6a3"
server_key_iv: "15e28db697122599c383014340462bf9"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.019471 11867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:57.038934 11867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:57.041920 11867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:57.042068 11867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:57.046928 11867 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:35783
I20260810 04:54:57.046995 11975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:35783 every 8 connection(s)
I20260810 04:54:57.047421 11867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:54:57.048750 11976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:57.049289 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 11867
I20260810 04:54:57.049396 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:54:57.049656 16319 external_mini_cluster.cc:1428] Setting key 9bf20d3970039ad14757892514a3fc89
I20260810 04:54:57.052579 11976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf: Bootstrap starting.
I20260810 04:54:57.053505 11976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:57.053895 11976 log.cc:824] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:57.054771 11976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf: No bootstrap required, opened a new log
I20260810 04:54:57.057510 11976 raft_consensus.cc:348] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf994984c2d4733a71013c924420edf" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35783 } }
I20260810 04:54:57.057700 11976 raft_consensus.cc:374] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:57.057755 11976 raft_consensus.cc:729] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acf994984c2d4733a71013c924420edf, State: Initialized, Role: FOLLOWER
I20260810 04:54:57.057948 11976 consensus_queue.cc:260] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf994984c2d4733a71013c924420edf" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35783 } }
I20260810 04:54:57.058060 11976 raft_consensus.cc:388] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:54:57.058115 11976 raft_consensus.cc:482] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:54:57.058171 11976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 0 FOLLOWER]: Advancing to term 1
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:57.059033 11976 raft_consensus.cc:504] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf994984c2d4733a71013c924420edf" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35783 } }
I20260810 04:54:57.059173 11976 leader_election.cc:302] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acf994984c2d4733a71013c924420edf; no voters:
I20260810 04:54:57.059420 11976 leader_election.cc:288] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:54:57.059536 11982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:57.059762 11976 sys_catalog.cc:564] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:54:57.059772 11982 raft_consensus.cc:686] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [term 1 LEADER]: Becoming Leader. State: Replica: acf994984c2d4733a71013c924420edf, State: Running, Role: LEADER
I20260810 04:54:57.059988 11982 consensus_queue.cc:237] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf994984c2d4733a71013c924420edf" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35783 } }
I20260810 04:54:57.060770 11984 sys_catalog.cc:455] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [sys.catalog]: SysCatalogTable state changed. Reason: New leader acf994984c2d4733a71013c924420edf. Latest consensus state: current_term: 1 leader_uuid: "acf994984c2d4733a71013c924420edf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf994984c2d4733a71013c924420edf" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35783 } } }
I20260810 04:54:57.060858 11984 sys_catalog.cc:458] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:57.061280 11983 sys_catalog.cc:455] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acf994984c2d4733a71013c924420edf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acf994984c2d4733a71013c924420edf" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35783 } } }
I20260810 04:54:57.061386 11983 sys_catalog.cc:458] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:57.061439 11994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:54:57.062304 11994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:54:57.063516 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.050469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37438 (local address 127.15.239.254:35783)
0810 04:54:57.050695 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.050707 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.050751 (+ 44us) server_negotiation.cc:407] Connection header received
0810 04:54:57.051417 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.051428 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.051503 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.051699 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:57.052545 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.054043 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.055034 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.055696 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.055834 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.059012 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:57.059017 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:57.059017 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:57.059031 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:57.061693 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.062178 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.062182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.062183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.062292 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.062524 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.062525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.062526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.062809 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:57.063003 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.063085 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.063237 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
I20260810 04:54:57.064285 11994 catalog_manager.cc:1347] Generated new cluster ID: 7d16b2ff3294426bacc9d1b226b65a18
I20260810 04:54:57.064339 11994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:54:57.078334 11994 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:54:57.079197 11994 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:54:57.085554 11994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf: Generated new TSK 0
I20260810 04:54:57.085816 11994 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:54:57.124368 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35783
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:57.248979 12008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:57.249418 12008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:57.249477 12008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:57.250921 12008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:57.250972 12008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:57.251001 12008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:54:57.253053 12008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:57.253371 12008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:57.253693 12008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:57.260282 12021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.260284 12018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.260453 12019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:57.260637 12008 server_base.cc:1034] running on GCE node
I20260810 04:54:57.260878 12008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:57.261180 12008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:57.262380 12008 hybrid_clock.cc:648] HybridClock initialized: now 1786337697262375 us; error 41 us; skew 500 ppm
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:57.269663 12008 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:54:57.270174 12008 webserver.cc:460] Webserver started at http://127.15.239.193:41067/ using document root <none> and password file <none>
I20260810 04:54:57.270414 12008 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:57.270463 12008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:57.270573 12008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:57.271786 12008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "6c14675b4a5548c19657a6add56c5efd"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "27938de2f90a2d3307a4fd4615487a25"
server_key_iv: "ccc3b744537a5aab1590cd52b8579c92"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.272274 12008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "6c14675b4a5548c19657a6add56c5efd"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "27938de2f90a2d3307a4fd4615487a25"
server_key_iv: "ccc3b744537a5aab1590cd52b8579c92"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.273794 12008 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:54:57.274601 12029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.274832 12008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:54:57.274943 12008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "6c14675b4a5548c19657a6add56c5efd"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "27938de2f90a2d3307a4fd4615487a25"
server_key_iv: "ccc3b744537a5aab1590cd52b8579c92"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.275055 12008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:57.286875 12008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:57.289513 12008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:57.289644 12008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:57.289866 12008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:57.290267 12008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:57.290315 12008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.290342 12008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:57.290397 12008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.297564 12008 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:46797
I20260810 04:54:57.297647 12198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:46797 every 8 connection(s)
I20260810 04:54:57.298048 12008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:57.305684 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 12008
I20260810 04:54:57.305812 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:54:57.306077 16319 external_mini_cluster.cc:1428] Setting key 0db9a7c8d32007192d8ed76c3f62500f
I20260810 04:54:57.309559 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.299037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:53075 (local address 127.15.239.254:35783)
0810 04:54:57.299130 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.299133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.299325 (+ 192us) server_negotiation.cc:407] Connection header received
0810 04:54:57.299958 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.299960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.299973 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.300149 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:57.301330 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.301947 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.303045 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.303299 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.303378 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.306116 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:57.306118 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:57.306118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:57.306127 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:57.307826 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.308382 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.308383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.308383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.308462 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.308751 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.308752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.308753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.308907 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:57.308992 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.309335 (+ 343us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.309452 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:54:57.309815 12202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.298975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:35783 (local address 127.15.239.193:53075)
0810 04:54:57.299178 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.299222 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.299813 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.300244 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.300248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.300948 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:57.301199 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.301204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.302040 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.302041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.302934 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.302936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.303411 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.303412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.303552 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.304259 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:57.304270 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:57.305995 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:57.307941 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:57.307950 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:57.307953 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:57.308279 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:57.308545 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:57.308546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:57.308546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:57.308676 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:57.308980 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:57.308989 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:57.309167 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.309285 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.309483 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":125,"threads_started":1}
I20260810 04:54:57.310583 12200 heartbeater.cc:347] Connected to a master server at 127.15.239.254:35783
I20260810 04:54:57.310724 12200 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:57.310981 12200 heartbeater.cc:511] Master 127.15.239.254:35783 requested a full tablet report, sending...
I20260810 04:54:57.311769 11914 ts_manager.cc:194] Registered new tserver with Master: 6c14675b4a5548c19657a6add56c5efd (127.15.239.193:46797)
I20260810 04:54:57.312551 11914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:53075
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:54:57.339601 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35783
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:57.437456 12206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:57.437714 12206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:57.437739 12206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:57.438892 12206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:57.438931 12206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:57.438958 12206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:54:57.440541 12206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:57.440763 12206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:57.440981 12206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:57.446981 12220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.446972 12215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.446976 12217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:57.447360 12206 server_base.cc:1034] running on GCE node
I20260810 04:54:57.447605 12206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:57.447865 12206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:57.449043 12206 hybrid_clock.cc:648] HybridClock initialized: now 1786337697449032 us; error 36 us; skew 500 ppm
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:57.452296 12206 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:54:57.452895 12206 webserver.cc:460] Webserver started at http://127.15.239.194:40421/ using document root <none> and password file <none>
I20260810 04:54:57.453164 12206 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:57.453238 12206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:57.453411 12206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:57.454633 12206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "96d7169d3356403682db0eb559c31b44"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "46103cacddef182b0f67bcf0fe31bc2c"
server_key_iv: "dd942a7eb8fda36e3e891c6ca78f9903"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.455045 12206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "96d7169d3356403682db0eb559c31b44"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "46103cacddef182b0f67bcf0fe31bc2c"
server_key_iv: "dd942a7eb8fda36e3e891c6ca78f9903"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.456768 12206 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:54:57.457700 12229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.457926 12206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:57.458034 12206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "96d7169d3356403682db0eb559c31b44"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "46103cacddef182b0f67bcf0fe31bc2c"
server_key_iv: "dd942a7eb8fda36e3e891c6ca78f9903"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.458096 12206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:57.470852 12206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:57.473888 12206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:57.474040 12206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:57.474280 12206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:57.474689 12206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:57.474762 12206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.474812 12206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:57.474843 12206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.482179 12206 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:45493
I20260810 04:54:57.482276 12400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:45493 every 8 connection(s)
I20260810 04:54:57.482669 12206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:54:57.487260 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 12206
I20260810 04:54:57.487403 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:54:57.487636 16319 external_mini_cluster.cc:1428] Setting key 6c3a1686f7c53201254d96dad41b9606
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:57.494390 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.483588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:55261 (local address 127.15.239.254:35783)
0810 04:54:57.483687 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.483690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.483924 (+ 234us) server_negotiation.cc:407] Connection header received
0810 04:54:57.484615 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.484617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.484634 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.484693 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:57.485860 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.486426 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.487647 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.487997 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.488116 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.491064 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:57.491067 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:57.491067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:57.491077 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:57.492711 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.493220 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.493222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.493223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.493296 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.493594 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.493596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.493596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.493752 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:57.493836 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.494161 (+ 325us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.494270 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:54:57.494649 12403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.483535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:35783 (local address 127.15.239.194:55261)
0810 04:54:57.483764 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.483816 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.484479 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.484792 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.484798 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.485489 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:57.485730 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.485735 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.486541 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.486542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.487551 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.487555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.488125 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.488127 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.488299 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.489031 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:57.489042 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:57.490930 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:57.492830 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:57.492839 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:57.492842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:57.493118 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:57.493382 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:57.493383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:57.493383 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:57.493516 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:57.493826 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:57.493835 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:57.494015 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.494140 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.494341 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":110,"threads_started":1}
I20260810 04:54:57.495260 12401 heartbeater.cc:347] Connected to a master server at 127.15.239.254:35783
I20260810 04:54:57.495397 12401 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:57.495625 12401 heartbeater.cc:511] Master 127.15.239.254:35783 requested a full tablet report, sending...
I20260810 04:54:57.496258 11914 ts_manager.cc:194] Registered new tserver with Master: 96d7169d3356403682db0eb559c31b44 (127.15.239.194:45493)
I20260810 04:54:57.496731 11914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:55261
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:54:57.523445 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35783
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:54:57.620707 12406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:57.620957 12406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:57.620981 12406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:57.622164 12406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:57.622213 12406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:57.622241 12406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:54:57.623759 12406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:35783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:57.624061 12406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:57.624338 12406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:57.630103 12417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.630107 12419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:57.630323 12416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:57.630364 12406 server_base.cc:1034] running on GCE node
I20260810 04:54:57.630604 12406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:57.630820 12406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:57.631965 12406 hybrid_clock.cc:648] HybridClock initialized: now 1786337697631955 us; error 31 us; skew 500 ppm
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:54:57.634887 12406 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:54:57.635397 12406 webserver.cc:460] Webserver started at http://127.15.239.195:39569/ using document root <none> and password file <none>
I20260810 04:54:57.635609 12406 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:57.635653 12406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:57.635753 12406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:57.636972 12406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "6f481e3c25204084918a83f6e8ee0825"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "46e4053ccc0b3b4e6e59d249c874e418"
server_key_iv: "9bfdb65303374f91de894146670f574c"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.637319 12406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "6f481e3c25204084918a83f6e8ee0825"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "46e4053ccc0b3b4e6e59d249c874e418"
server_key_iv: "9bfdb65303374f91de894146670f574c"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.638761 12406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:54:57.639555 12429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.639771 12406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:54:57.639930 12406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "6f481e3c25204084918a83f6e8ee0825"
format_stamp: "Formatted at 2026-08-10 04:54:57 on dist-test-slave-kvfs"
server_key: "46e4053ccc0b3b4e6e59d249c874e418"
server_key_iv: "9bfdb65303374f91de894146670f574c"
server_key_version: "encryptionkey@0"
I20260810 04:54:57.640018 12406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:57.648761 12406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:57.651314 12406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:57.651499 12406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:57.651778 12406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:57.652218 12406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:57.652287 12406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.652335 12406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:57.652369 12406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:57.659747 12406 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:34153
I20260810 04:54:57.659765 12604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:34153 every 8 connection(s)
I20260810 04:54:57.660372 12406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:54:57.661064 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 12406
I20260810 04:54:57.661170 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:54:57.661437 16319 external_mini_cluster.cc:1428] Setting key 6cce2f16e62111644473f863e25ece32
Aug 10 04:54:57 dist-test-slave-kvfs krb5kdc[11843](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337697, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:54:57.670917 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.661368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:54017 (local address 127.15.239.254:35783)
0810 04:54:57.661462 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.661465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.661708 (+ 243us) server_negotiation.cc:407] Connection header received
0810 04:54:57.662432 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.662433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.662447 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.662499 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:57.663634 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.664303 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.665422 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.665638 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.665725 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.668131 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:57.668132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:57.668133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:57.668141 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:57.669503 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.669916 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.669918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.669918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.669982 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.670269 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.670269 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.670270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.670391 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:57.670458 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.670759 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.670839 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:54:57.671200 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.661328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:35783 (local address 127.15.239.195:54017)
0810 04:54:57.661566 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.661616 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.662306 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.662597 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.662604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.663273 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:57.663516 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.663522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.664403 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.664405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.665306 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.665308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.665736 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.665738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.665883 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.666482 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:54:57.666492 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:57.668007 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:57.669581 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:57.669588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:57.669590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:57.669823 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:57.670074 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:54:57.670075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:54:57.670075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:54:57.670193 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:54:57.670481 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:57.670488 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:57.670637 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.670738 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.670900 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":120,"threads_started":1}
I20260810 04:54:57.671792 12605 heartbeater.cc:347] Connected to a master server at 127.15.239.254:35783
I20260810 04:54:57.671917 12605 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:57.672150 12605 heartbeater.cc:511] Master 127.15.239.254:35783 requested a full tablet report, sending...
I20260810 04:54:57.672639 11914 ts_manager.cc:194] Registered new tserver with Master: 6f481e3c25204084918a83f6e8ee0825 (127.15.239.195:34153)
I20260810 04:54:57.673138 11914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:54017
I20260810 04:54:57.673247 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:54:57.681411 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.674825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37448 (local address 127.15.239.254:35783)
0810 04:54:57.674895 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.674898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.675008 (+ 110us) server_negotiation.cc:407] Connection header received
0810 04:54:57.675065 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.675066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.675074 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.675125 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:57.675698 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.676245 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.676999 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.677182 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.677231 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.678645 (+ 1414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:57.678647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:57.678647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:54:57.678654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:57.680214 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.680574 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.680574 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.680575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.680629 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:54:57.680810 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:54:57.680811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:54:57.680811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:54:57.680938 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:57.681028 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.681243 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.681327 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:54:57.683282 11914 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:54:57.685448 11914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:54:57.692963 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.688609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33248 (local address 127.15.239.195:34153)
0810 04:54:57.689120 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.689125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.689142 (+ 17us) server_negotiation.cc:407] Connection header received
0810 04:54:57.689186 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.689188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.689207 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.689474 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:57.689535 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.690260 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.691743 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.692487 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.692589 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.692664 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.692811 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.692871 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":101,"threads_started":1}
I20260810 04:54:57.692950 12624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.688401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:34153 (local address 127.0.0.1:33248)
0810 04:54:57.688575 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.688620 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.688700 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.689323 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.689325 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.689328 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:57.689406 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.689408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.690375 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.690376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.691641 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.691645 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.692585 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.692586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.692667 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.692682 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.692789 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.692859 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":12,"thread_start_us":51,"threads_started":1}
I20260810 04:54:57.693137 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.688405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:45493 (local address 127.0.0.1:46632)
0810 04:54:57.688717 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.688726 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.688773 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.689294 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.689298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.689301 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:57.689406 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.689409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.690835 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.690836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.691969 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.691971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.692934 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.692935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.692989 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.692993 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.693024 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.693059 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":34,"thread_start_us":125,"threads_started":1}
I20260810 04:54:57.693246 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.688430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:46797 (local address 127.0.0.1:59072)
0810 04:54:57.688865 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.688878 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.688927 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.689323 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.689324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.689336 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:57.689408 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.689409 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.690844 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.690844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.691809 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.691812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.692820 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.692821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.692888 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.692895 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.692927 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.692968 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":81,"thread_start_us":109,"threads_started":1}
I20260810 04:54:57.693284 12630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.688714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59072 (local address 127.15.239.193:46797)
0810 04:54:57.689027 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.689036 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.689049 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:54:57.689200 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.689202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.689220 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.689492 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:57.689580 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.690710 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.691903 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.692708 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.693023 (+ 315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.693094 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.693122 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.693174 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":123,"threads_started":1}
I20260810 04:54:57.694140 12098 tablet_service.cc:1467] Processing CreateTablet for tablet 2db8afa13cb140428c3496c771d1048d (DEFAULT_TABLE table=test-table [id=124c5ef4fa314ae4a536865054ea15af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:57.694360 12506 tablet_service.cc:1467] Processing CreateTablet for tablet 2db8afa13cb140428c3496c771d1048d (DEFAULT_TABLE table=test-table [id=124c5ef4fa314ae4a536865054ea15af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:57.694717 12098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db8afa13cb140428c3496c771d1048d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:57.694811 12506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db8afa13cb140428c3496c771d1048d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:57.696161 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.688847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46632 (local address 127.15.239.194:45493)
0810 04:54:57.689076 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.689080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.689091 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:54:57.689138 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.689140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.689159 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.689492 (+ 333us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:57.689579 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.690702 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.692083 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.692826 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.693356 (+ 530us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.693433 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.693465 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.693515 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":94,"threads_started":1}
I20260810 04:54:57.698096 12633 tablet_bootstrap.cc:492] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: Bootstrap starting.
I20260810 04:54:57.698729 12303 tablet_service.cc:1467] Processing CreateTablet for tablet 2db8afa13cb140428c3496c771d1048d (DEFAULT_TABLE table=test-table [id=124c5ef4fa314ae4a536865054ea15af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:57.699108 12303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2db8afa13cb140428c3496c771d1048d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:57.700714 12633 tablet_bootstrap.cc:654] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:57.701009 12636 tablet_bootstrap.cc:492] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Bootstrap starting.
I20260810 04:54:57.701426 12633 log.cc:824] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:57.701838 12636 tablet_bootstrap.cc:654] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:57.702255 12643 tablet_bootstrap.cc:492] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Bootstrap starting.
I20260810 04:54:57.702451 12636 log.cc:824] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:57.702495 12633 tablet_bootstrap.cc:492] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: No bootstrap required, opened a new log
I20260810 04:54:57.702661 12633 ts_tablet_manager.cc:1397] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 04:54:57.702979 12643 tablet_bootstrap.cc:654] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:57.703474 12643 log.cc:824] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:57.704370 12643 tablet_bootstrap.cc:492] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: No bootstrap required, opened a new log
I20260810 04:54:57.704452 12643 ts_tablet_manager.cc:1397] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:54:57.704675 12633 raft_consensus.cc:348] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.704895 12633 raft_consensus.cc:374] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:57.704941 12633 raft_consensus.cc:729] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c14675b4a5548c19657a6add56c5efd, State: Initialized, Role: FOLLOWER
I20260810 04:54:57.705075 12633 consensus_queue.cc:260] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.705402 12633 ts_tablet_manager.cc:1428] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:54:57.705571 12200 heartbeater.cc:503] Master 127.15.239.254:35783 was elected leader, sending a full tablet report...
I20260810 04:54:57.706323 12643 raft_consensus.cc:348] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.706472 12643 raft_consensus.cc:374] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:57.706494 12643 raft_consensus.cc:729] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96d7169d3356403682db0eb559c31b44, State: Initialized, Role: FOLLOWER
I20260810 04:54:57.706576 12643 consensus_queue.cc:260] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.706893 12643 ts_tablet_manager.cc:1428] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:54:57.706972 12401 heartbeater.cc:503] Master 127.15.239.254:35783 was elected leader, sending a full tablet report...
I20260810 04:54:57.707393 12636 tablet_bootstrap.cc:492] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: No bootstrap required, opened a new log
I20260810 04:54:57.707466 12636 ts_tablet_manager.cc:1397] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 04:54:57.709247 12636 raft_consensus.cc:348] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.709394 12636 raft_consensus.cc:374] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:57.709419 12636 raft_consensus.cc:729] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f481e3c25204084918a83f6e8ee0825, State: Initialized, Role: FOLLOWER
I20260810 04:54:57.709534 12636 consensus_queue.cc:260] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.709787 12636 ts_tablet_manager.cc:1428] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 04:54:57.709914 12605 heartbeater.cc:503] Master 127.15.239.254:35783 was elected leader, sending a full tablet report...
W20260810 04:54:57.733412 12402 tablet.cc:2369] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:54:57.799017 12201 tablet.cc:2369] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:54:57.800644 12652 raft_consensus.cc:482] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:57.800840 12652 raft_consensus.cc:504] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.801403 12652 leader_election.cc:288] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96d7169d3356403682db0eb559c31b44 (127.15.239.194:45493), 6c14675b4a5548c19657a6add56c5efd (127.15.239.193:46797)
I20260810 04:54:57.805845 12630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.801730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:44587 (local address 127.15.239.193:46797)
0810 04:54:57.801816 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.801819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.801833 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:54:57.801874 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.801875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.801886 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.801965 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:57.802163 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.803034 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.804761 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.805373 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.805467 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.805479 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.805706 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.805762 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 04:54:57.805841 12607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.801645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:46797 (local address 127.15.239.195:44587)
0810 04:54:57.801711 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.801727 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.801789 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.801974 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.801975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.801977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:57.802079 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.802082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.803178 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.803179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.804638 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.804643 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.805494 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.805496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.805596 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.805599 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.805662 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.805720 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":17}
I20260810 04:54:57.805863 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.801845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:50665 (local address 127.15.239.194:45493)
0810 04:54:57.801897 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.801899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.802064 (+ 165us) server_negotiation.cc:407] Connection header received
0810 04:54:57.802096 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.802097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.802105 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.802180 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:57.802346 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.803088 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.804760 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.805391 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.805467 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.805479 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.805706 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.805765 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 04:54:57.805852 12653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.801660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:45493 (local address 127.15.239.195:50665)
0810 04:54:57.801961 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.801971 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:57.802035 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:57.802208 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:57.802209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:57.802210 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:57.802271 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.802272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.803187 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.803187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.804642 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:57.804643 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.805495 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.805496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:57.805588 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.805594 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:54:57.805662 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:54:57.805718 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":209,"thread_start_us":145,"threads_started":1}
I20260810 04:54:57.806381 12332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db8afa13cb140428c3496c771d1048d" candidate_uuid: "6f481e3c25204084918a83f6e8ee0825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96d7169d3356403682db0eb559c31b44" is_pre_election: true
I20260810 04:54:57.806468 12127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db8afa13cb140428c3496c771d1048d" candidate_uuid: "6f481e3c25204084918a83f6e8ee0825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c14675b4a5548c19657a6add56c5efd" is_pre_election: true
I20260810 04:54:57.806627 12332 raft_consensus.cc:2454] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f481e3c25204084918a83f6e8ee0825 in term 0.
I20260810 04:54:57.806682 12127 raft_consensus.cc:2454] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f481e3c25204084918a83f6e8ee0825 in term 0.
I20260810 04:54:57.806924 12435 leader_election.cc:302] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f481e3c25204084918a83f6e8ee0825, 96d7169d3356403682db0eb559c31b44; no voters:
I20260810 04:54:57.807092 12652 raft_consensus.cc:2781] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:54:57.807158 12652 raft_consensus.cc:482] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:54:57.807237 12652 raft_consensus.cc:3037] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:57.808212 12652 raft_consensus.cc:504] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.808385 12652 leader_election.cc:288] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [CANDIDATE]: Term 1 election: Requested vote from peers 96d7169d3356403682db0eb559c31b44 (127.15.239.194:45493), 6c14675b4a5548c19657a6add56c5efd (127.15.239.193:46797)
I20260810 04:54:57.808580 12332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db8afa13cb140428c3496c771d1048d" candidate_uuid: "6f481e3c25204084918a83f6e8ee0825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96d7169d3356403682db0eb559c31b44"
I20260810 04:54:57.808589 12127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2db8afa13cb140428c3496c771d1048d" candidate_uuid: "6f481e3c25204084918a83f6e8ee0825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c14675b4a5548c19657a6add56c5efd"
I20260810 04:54:57.808665 12127 raft_consensus.cc:3037] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:57.808679 12332 raft_consensus.cc:3037] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:57.809551 12332 raft_consensus.cc:2454] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f481e3c25204084918a83f6e8ee0825 in term 1.
I20260810 04:54:57.809549 12127 raft_consensus.cc:2454] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f481e3c25204084918a83f6e8ee0825 in term 1.
I20260810 04:54:57.809751 12434 leader_election.cc:302] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c14675b4a5548c19657a6add56c5efd, 6f481e3c25204084918a83f6e8ee0825; no voters:
I20260810 04:54:57.809859 12652 raft_consensus.cc:2781] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:57.810109 12652 raft_consensus.cc:686] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 1 LEADER]: Becoming Leader. State: Replica: 6f481e3c25204084918a83f6e8ee0825, State: Running, Role: LEADER
I20260810 04:54:57.810235 12652 consensus_queue.cc:237] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } }
I20260810 04:54:57.811410 11914 catalog_manager.cc:5495] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f481e3c25204084918a83f6e8ee0825 (127.15.239.195). New cstate: current_term: 1 leader_uuid: "6f481e3c25204084918a83f6e8ee0825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f481e3c25204084918a83f6e8ee0825" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260810 04:54:57.841622 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.838806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33258 (local address 127.15.239.195:34153)
0810 04:54:57.838911 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:57.838913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:57.838936 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:54:57.838982 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:57.838982 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:57.839006 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:57.839068 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:54:57.839230 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.839754 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.840633 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:57.840842 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:57.840900 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:57.841052 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:54:57.841161 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:54:57.841243 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:57.841444 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 04:54:57.841462 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 04:54:57.844226 12332 raft_consensus.cc:1261] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 1 FOLLOWER]: Refusing update from remote peer 6f481e3c25204084918a83f6e8ee0825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:57.844275 12127 raft_consensus.cc:1261] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 1 FOLLOWER]: Refusing update from remote peer 6f481e3c25204084918a83f6e8ee0825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:57.844638 12652 consensus_queue.cc:1035] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96d7169d3356403682db0eb559c31b44" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:57.844815 12654 consensus_queue.cc:1035] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c14675b4a5548c19657a6add56c5efd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:57.847435 12657 mvcc.cc:205] Tried to move back new op lower bound from 7316839210366447616 to 7316839210231549952. Current Snapshot: MvccSnapshot[applied={T|T < 7316839210366447616}]
I20260810 04:54:57.847976 12660 mvcc.cc:205] Tried to move back new op lower bound from 7316839210366447616 to 7316839210231549952. Current Snapshot: MvccSnapshot[applied={T|T < 7316839210366447616}]
I20260810 04:54:57.848475 12658 mvcc.cc:205] Tried to move back new op lower bound from 7316839210366447616 to 7316839210231549952. Current Snapshot: MvccSnapshot[applied={T|T < 7316839210366447616}]
I20260810 04:54:57.850679 11912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:57.850792 11912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:57.851764 11912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P acf994984c2d4733a71013c924420edf: Sending DeleteTablet for 3 replicas of tablet 2db8afa13cb140428c3496c771d1048d
I20260810 04:54:57.852170 12506 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db8afa13cb140428c3496c771d1048d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:57 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:33248
I20260810 04:54:57.852187 12303 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db8afa13cb140428c3496c771d1048d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:57 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:46632
I20260810 04:54:57.852473 12669 tablet_replica.cc:330] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: stopping tablet replica
I20260810 04:54:57.852583 12098 tablet_service.cc:1514] Processing DeleteTablet for tablet 2db8afa13cb140428c3496c771d1048d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:57 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59072
I20260810 04:54:57.852624 12669 raft_consensus.cc:2229] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:57.852639 12670 tablet_replica.cc:330] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: stopping tablet replica
I20260810 04:54:57.852742 12670 raft_consensus.cc:2229] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:54:57.852814 12669 raft_consensus.cc:2258] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:57.852869 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 12008
I20260810 04:54:57.852882 12670 raft_consensus.cc:2258] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:57.852964 12671 tablet_replica.cc:330] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd: stopping tablet replica
I20260810 04:54:57.853058 12671 raft_consensus.cc:2229] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:57.853147 12671 raft_consensus.cc:2258] T 2db8afa13cb140428c3496c771d1048d P 6c14675b4a5548c19657a6add56c5efd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:57.857750 12670 ts_tablet_manager.cc:1905] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:57.860374 12670 ts_tablet_manager.cc:1918] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:57.860491 12670 log.cc:1196] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/2db8afa13cb140428c3496c771d1048d
I20260810 04:54:57.860800 12670 ts_tablet_manager.cc:1939] T 2db8afa13cb140428c3496c771d1048d P 6f481e3c25204084918a83f6e8ee0825: Deleting consensus metadata
I20260810 04:54:57.861338 11889 catalog_manager.cc:4841] TS 6f481e3c25204084918a83f6e8ee0825 (127.15.239.195:34153): tablet 2db8afa13cb140428c3496c771d1048d (table test-table [id=124c5ef4fa314ae4a536865054ea15af]) successfully deleted
I20260810 04:54:57.865554 12669 ts_tablet_manager.cc:1905] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:57.867865 12669 ts_tablet_manager.cc:1918] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:57.867970 12669 log.cc:1196] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/2db8afa13cb140428c3496c771d1048d
I20260810 04:54:57.868336 12669 ts_tablet_manager.cc:1939] T 2db8afa13cb140428c3496c771d1048d P 96d7169d3356403682db0eb559c31b44: Deleting consensus metadata
I20260810 04:54:57.868939 11893 catalog_manager.cc:4841] TS 96d7169d3356403682db0eb559c31b44 (127.15.239.194:45493): tablet 2db8afa13cb140428c3496c771d1048d (table test-table [id=124c5ef4fa314ae4a536865054ea15af]) successfully deleted
W20260810 04:54:57.871740 11891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:46797 (error 108)
I20260810 04:54:57.872057 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 12206
I20260810 04:54:57.909260 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:57.908998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:46797 (local address 127.0.0.1:59084)
0810 04:54:57.909101 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:57.909185 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:46797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260810 04:54:57.909590 11891 catalog_manager.cc:4584] TS 6c14675b4a5548c19657a6add56c5efd (127.15.239.193:46797): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2db8afa13cb140428c3496c771d1048d: Network error: Client connection negotiation failed: client connection to 127.15.239.193:46797: connect: Connection refused (error 111)
I20260810 04:54:57.915500 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 12406
I20260810 04:54:57.933794 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 11867
2026-08-10T04:54:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2483 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T04:54:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:54:57Z Disabled control of system clock
I20260810 04:54:57.976342 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:43051
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:39679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:43051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:54:58.074615 12680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:58.074903 12680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:58.074927 12680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:58.076151 12680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:54:58.076188 12680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:58.076201 12680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:58.076215 12680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:54:58.076227 12680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:54:58.077589 12680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:43051
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:43051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:58.077841 12680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:58.078145 12680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:58.084153 12693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.084177 12687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.084151 12690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:58.084179 12680 server_base.cc:1034] running on GCE node
I20260810 04:54:58.084854 12680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:58.085204 12680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:58.086392 12680 hybrid_clock.cc:648] HybridClock initialized: now 1786337698086364 us; error 46 us; skew 500 ppm
I20260810 04:54:58.088114 12680 webserver.cc:460] Webserver started at http://127.15.239.254:39931/ using document root <none> and password file <none>
I20260810 04:54:58.088406 12680 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:58.088485 12680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:58.088654 12680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:58.089951 12680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "a9ce37503f1248668917dc5f494e7311"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "1f482be516f7507a446a49ece98f3297"
server_key_iv: "7a3e89e7576e81586b2921fbf3cef8fa"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.090381 12680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "a9ce37503f1248668917dc5f494e7311"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "1f482be516f7507a446a49ece98f3297"
server_key_iv: "7a3e89e7576e81586b2921fbf3cef8fa"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.091976 12680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:54:58.092952 12703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.093170 12680 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:58.093307 12680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "a9ce37503f1248668917dc5f494e7311"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "1f482be516f7507a446a49ece98f3297"
server_key_iv: "7a3e89e7576e81586b2921fbf3cef8fa"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.093395 12680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:58.115307 12680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:58.115782 12680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:58.115975 12680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:58.120913 12680 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:43051
I20260810 04:54:58.120958 12773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:43051 every 8 connection(s)
I20260810 04:54:58.121404 12680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:54:58.122473 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 12680
I20260810 04:54:58.122607 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:54:58.122781 12774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:58.122915 16319 external_mini_cluster.cc:1428] Setting key 356201cf3cdd7a506e4063c6c3a518bd
I20260810 04:54:58.127460 12774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311: Bootstrap starting.
I20260810 04:54:58.128407 12774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:58.128815 12774 log.cc:824] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:58.130051 12774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311: No bootstrap required, opened a new log
I20260810 04:54:58.130409 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.123616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56262 (local address 127.15.239.254:43051)
0810 04:54:58.123878 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.123889 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.123929 (+ 40us) server_negotiation.cc:407] Connection header received
0810 04:54:58.124649 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.124662 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.124768 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.124957 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:58.125256 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.126727 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.127724 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.128271 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.128454 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.129382 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:58.129388 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:58.129389 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:58.129652 (+ 263us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:58.129713 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:58.129728 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:58.129807 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.129898 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.129996 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":126,"threads_started":1}
I20260810 04:54:58.133013 12774 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ce37503f1248668917dc5f494e7311" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43051 } }
I20260810 04:54:58.133220 12774 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:58.133248 12774 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ce37503f1248668917dc5f494e7311, State: Initialized, Role: FOLLOWER
I20260810 04:54:58.133420 12774 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ce37503f1248668917dc5f494e7311" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43051 } }
I20260810 04:54:58.133493 12774 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:54:58.133538 12774 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:54:58.133591 12774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:58.134313 12774 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ce37503f1248668917dc5f494e7311" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43051 } }
I20260810 04:54:58.134449 12774 leader_election.cc:302] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9ce37503f1248668917dc5f494e7311; no voters:
I20260810 04:54:58.134704 12774 leader_election.cc:288] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:54:58.134886 12782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:58.135030 12782 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [term 1 LEADER]: Becoming Leader. State: Replica: a9ce37503f1248668917dc5f494e7311, State: Running, Role: LEADER
I20260810 04:54:58.135062 12774 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:54:58.135138 12782 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ce37503f1248668917dc5f494e7311" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43051 } }
I20260810 04:54:58.135587 12783 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9ce37503f1248668917dc5f494e7311. Latest consensus state: current_term: 1 leader_uuid: "a9ce37503f1248668917dc5f494e7311" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ce37503f1248668917dc5f494e7311" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43051 } } }
I20260810 04:54:58.135696 12783 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:58.135901 12780 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9ce37503f1248668917dc5f494e7311" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ce37503f1248668917dc5f494e7311" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 43051 } } }
I20260810 04:54:58.135978 12780 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311 [sys.catalog]: This master's current role is: LEADER
I20260810 04:54:58.135965 12789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:54:58.136917 12789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:54:58.138749 12789 catalog_manager.cc:1347] Generated new cluster ID: 1ba816e7022f45dba3f053964307020c
I20260810 04:54:58.138815 12789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:54:58.193608 12789 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:54:58.194500 12789 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:54:58.200546 12789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311: Generated new TSK 0
I20260810 04:54:58.200850 12789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:54:58.208534 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43051
--builtin_ntp_servers=127.15.239.212:39679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:54:58.312224 12811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:58.312508 12811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:58.312532 12811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:58.313867 12811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:58.313923 12811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:58.313951 12811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:54:58.315490 12811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:58.315860 12811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:58.316326 12811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:54:58.322885 12811 server_base.cc:1034] running on GCE node
W20260810 04:54:58.322841 12819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.322839 12825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.322844 12821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:58.323530 12811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:58.323933 12811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:58.325137 12811 hybrid_clock.cc:648] HybridClock initialized: now 1786337698325128 us; error 62 us; skew 500 ppm
I20260810 04:54:58.327193 12811 webserver.cc:460] Webserver started at http://127.15.239.193:37601/ using document root <none> and password file <none>
I20260810 04:54:58.327593 12811 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:58.327687 12811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:58.327888 12811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:58.329464 12811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "ff38afb1ad41963aafcc47aec14272fd"
server_key_iv: "e892d40413bf06f93d76c04da9a08bad"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.329950 12811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "ff38afb1ad41963aafcc47aec14272fd"
server_key_iv: "e892d40413bf06f93d76c04da9a08bad"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.331867 12811 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:54:58.332978 12832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.333410 12811 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:54:58.333564 12811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "ff38afb1ad41963aafcc47aec14272fd"
server_key_iv: "e892d40413bf06f93d76c04da9a08bad"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.333669 12811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:58.357097 12811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:58.357584 12811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:58.357786 12811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:58.358124 12811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:58.358775 12811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:58.358878 12811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.358924 12811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:58.358985 12811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.366427 12811 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:37071
I20260810 04:54:58.366498 13002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:37071 every 8 connection(s)
I20260810 04:54:58.366928 12811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:54:58.367595 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 12811
I20260810 04:54:58.367729 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:54:58.368069 16319 external_mini_cluster.cc:1428] Setting key d512859b876bbc1085e66d84eb6858d7
I20260810 04:54:58.369360 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43051
--builtin_ntp_servers=127.15.239.212:39679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 04:54:58.374199 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.368051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:56341 (local address 127.15.239.254:43051)
0810 04:54:58.368158 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.368161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.368476 (+ 315us) server_negotiation.cc:407] Connection header received
0810 04:54:58.369262 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.369264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.369279 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.369385 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:58.370272 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.371109 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.372335 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.372667 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.372755 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.373838 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:58.373839 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:58.373840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:58.373846 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:58.373867 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:58.373872 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:58.373932 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.374056 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.374097 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 04:54:58.374498 13006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.367985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:43051 (local address 127.15.239.193:56341)
0810 04:54:58.368310 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.368365 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.369142 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.369458 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.369463 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.369479 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:58.370174 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.370180 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.371220 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.371221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.372247 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.372250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.372766 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.372767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.372917 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.373646 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:54:58.373646 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:58.373684 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:54:58.373714 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:58.373948 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:58.373955 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:58.373960 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.374057 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.374201 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":123,"threads_started":1}
I20260810 04:54:58.375092 13004 heartbeater.cc:347] Connected to a master server at 127.15.239.254:43051
I20260810 04:54:58.375205 13004 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:58.375470 13004 heartbeater.cc:511] Master 127.15.239.254:43051 requested a full tablet report, sending...
I20260810 04:54:58.376222 12726 ts_manager.cc:194] Registered new tserver with Master: 6771e09c3ec146e3b4c8847ac7eaa7fd (127.15.239.193:37071)
I20260810 04:54:58.376940 12726 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.193:56341
W20260810 04:54:58.468242 13007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:58.468539 13007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:58.468578 13007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:58.469800 13007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:58.469867 13007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:58.469911 13007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:54:58.471366 13007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:58.471688 13007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:58.472077 13007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:58.477944 13021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.477970 13018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.477893 13017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:58.478065 13007 server_base.cc:1034] running on GCE node
I20260810 04:54:58.478318 13007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:58.478561 13007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:58.479702 13007 hybrid_clock.cc:648] HybridClock initialized: now 1786337698479681 us; error 39 us; skew 500 ppm
I20260810 04:54:58.481290 13007 webserver.cc:460] Webserver started at http://127.15.239.194:35075/ using document root <none> and password file <none>
I20260810 04:54:58.481544 13007 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:58.481591 13007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:58.481699 13007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:58.482897 13007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "4666b36fe2894e8d8fac85dde9afc106"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "80e203399b62cac742be3f47ea265552"
server_key_iv: "a6ba2bbc4cd97aaa0c7574323dabfa43"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.483253 13007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "4666b36fe2894e8d8fac85dde9afc106"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "80e203399b62cac742be3f47ea265552"
server_key_iv: "a6ba2bbc4cd97aaa0c7574323dabfa43"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.484743 13007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:54:58.485481 13032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.485661 13007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:54:58.485781 13007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "4666b36fe2894e8d8fac85dde9afc106"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "80e203399b62cac742be3f47ea265552"
server_key_iv: "a6ba2bbc4cd97aaa0c7574323dabfa43"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.485868 13007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:58.509728 13007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:58.510167 13007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:58.510352 13007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:58.510681 13007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:58.511104 13007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:58.511173 13007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.511242 13007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:58.511274 13007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.518237 13007 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:38371
I20260810 04:54:58.518342 13203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:38371 every 8 connection(s)
I20260810 04:54:58.518754 13007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:54:58.525346 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.519772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:42603 (local address 127.15.239.254:43051)
0810 04:54:58.519872 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.519875 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.520134 (+ 259us) server_negotiation.cc:407] Connection header received
0810 04:54:58.520752 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.520753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.520768 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.520844 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:58.521693 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.522432 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.523498 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.523704 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.523776 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.524929 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:58.524932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:58.524932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:58.524939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:58.524962 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:58.524966 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:58.525025 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.525225 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.525260 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 04:54:58.525543 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.519690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:43051 (local address 127.15.239.194:42603)
0810 04:54:58.519913 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.519970 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.520630 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.520957 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.520961 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.520973 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:58.521582 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.521586 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.522529 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.522530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.523402 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.523404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.523796 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.523797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.523925 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.524712 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:54:58.524712 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:58.524748 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:54:58.524777 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:58.525083 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:58.525090 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:58.525093 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.525174 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.525288 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
I20260810 04:54:58.526254 13206 heartbeater.cc:347] Connected to a master server at 127.15.239.254:43051
I20260810 04:54:58.526407 13206 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:58.526639 13206 heartbeater.cc:511] Master 127.15.239.254:43051 requested a full tablet report, sending...
I20260810 04:54:58.527195 12726 ts_manager.cc:194] Registered new tserver with Master: 4666b36fe2894e8d8fac85dde9afc106 (127.15.239.194:38371)
I20260810 04:54:58.527628 12726 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.194:42603
I20260810 04:54:58.528522 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 13007
I20260810 04:54:58.528656 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:54:58.528893 16319 external_mini_cluster.cc:1428] Setting key aac82913b148e0ed6894156dc00c7f78
I20260810 04:54:58.530059 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43051
--builtin_ntp_servers=127.15.239.212:39679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:54:58.626969 13210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:54:58.627225 13210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:54:58.627249 13210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:54:58.628603 13210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:54:58.628654 13210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:54:58.628682 13210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:54:58.630072 13210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:54:58.630313 13210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:54:58.630746 13210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:54:58.636759 13219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.636847 13224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:54:58.636747 13220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:54:58.637029 13210 server_base.cc:1034] running on GCE node
I20260810 04:54:58.637244 13210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:54:58.637580 13210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:54:58.638743 13210 hybrid_clock.cc:648] HybridClock initialized: now 1786337698638715 us; error 44 us; skew 500 ppm
I20260810 04:54:58.640343 13210 webserver.cc:460] Webserver started at http://127.15.239.195:44157/ using document root <none> and password file <none>
I20260810 04:54:58.640611 13210 fs_manager.cc:359] Metadata directory not provided
I20260810 04:54:58.640657 13210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:54:58.640770 13210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:54:58.641987 13210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "7c13827f2d61421c9ec340318e2f7fd3"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "1e096201c8f3313295270689fe2039a6"
server_key_iv: "336ac6436195f09346d65de500283c57"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.642338 13210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "7c13827f2d61421c9ec340318e2f7fd3"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "1e096201c8f3313295270689fe2039a6"
server_key_iv: "336ac6436195f09346d65de500283c57"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.643754 13210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:54:58.644685 13232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.644918 13210 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:54:58.645042 13210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "7c13827f2d61421c9ec340318e2f7fd3"
format_stamp: "Formatted at 2026-08-10 04:54:58 on dist-test-slave-kvfs"
server_key: "1e096201c8f3313295270689fe2039a6"
server_key_iv: "336ac6436195f09346d65de500283c57"
server_key_version: "encryptionkey@0"
I20260810 04:54:58.645128 13210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:54:58.671114 13210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:54:58.671557 13210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:54:58.671736 13210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:54:58.672075 13210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:54:58.672508 13210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:54:58.672569 13210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.672612 13210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:54:58.672658 13210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:54:58.679759 13210 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:34345
I20260810 04:54:58.679821 13408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:34345 every 8 connection(s)
I20260810 04:54:58.680286 13210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:54:58.686789 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.681220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:42333 (local address 127.15.239.254:43051)
0810 04:54:58.681313 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.681316 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.681613 (+ 297us) server_negotiation.cc:407] Connection header received
0810 04:54:58.682278 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.682280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.682297 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.682369 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:58.683422 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.684068 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.685194 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.685400 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.685475 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.686525 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:58.686527 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:58.686527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:58.686532 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:58.686552 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:58.686556 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:58.686607 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.686680 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.686710 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 04:54:58.687054 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.681224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:43051 (local address 127.15.239.195:42333)
0810 04:54:58.681456 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.681498 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.682134 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.682457 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.682461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.682474 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:54:58.683320 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.683326 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.684181 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.684182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.685096 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.685099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.685517 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.685518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.685657 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.686353 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:54:58.686353 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:54:58.686389 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:54:58.686416 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:54:58.686619 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:54:58.686623 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:54:58.686626 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.686684 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.686784 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
I20260810 04:54:58.687678 13409 heartbeater.cc:347] Connected to a master server at 127.15.239.254:43051
I20260810 04:54:58.687803 13409 heartbeater.cc:464] Registering TS with master...
I20260810 04:54:58.688136 13409 heartbeater.cc:511] Master 127.15.239.254:43051 requested a full tablet report, sending...
I20260810 04:54:58.688663 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 13210
I20260810 04:54:58.688778 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:54:58.688735 12726 ts_manager.cc:194] Registered new tserver with Master: 7c13827f2d61421c9ec340318e2f7fd3 (127.15.239.195:34345)
I20260810 04:54:58.689043 16319 external_mini_cluster.cc:1428] Setting key 3423482be2d91b18bf0d2ca3d40a138c
I20260810 04:54:58.689307 12726 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.195:42333
I20260810 04:54:58.690111 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:54:58.694849 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.691762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56272 (local address 127.15.239.254:43051)
0810 04:54:58.691831 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.691833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.691977 (+ 144us) server_negotiation.cc:407] Connection header received
0810 04:54:58.692067 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.692068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.692079 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.692142 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:54:58.692285 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.692766 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.693510 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.693696 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.693748 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.694527 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:54:58.694528 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:54:58.694529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:54:58.694533 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:54:58.694546 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:54:58.694550 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:54:58.694631 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.694695 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.694706 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:54:58.697161 12725 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:54:58.699259 12725 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:54:58.706736 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.702202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:34345 (local address 127.0.0.1:51886)
0810 04:54:58.702366 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.702412 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.702517 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.703034 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.703037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.703040 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:58.703133 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.703135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.704545 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.704546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.705617 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.705620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.706473 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.706474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.706543 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.706556 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.706619 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.706662 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":5,"thread_start_us":102,"threads_started":1}
I20260810 04:54:58.706781 13423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.702573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51886 (local address 127.15.239.195:34345)
0810 04:54:58.702766 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.702773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.702785 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:54:58.702841 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.702872 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.702894 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.703012 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:58.703226 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.704450 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.705724 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.706382 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.706466 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.706572 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.706633 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.706678 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":116,"threads_started":1}
I20260810 04:54:58.707784 13316 tablet_service.cc:1467] Processing CreateTablet for tablet 409b686ae04348b788d8fffed4db11e2 (DEFAULT_TABLE table=test-table [id=71bac5ae8485462485f07999b04581d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:58.708276 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.702218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:38371 (local address 127.0.0.1:49224)
0810 04:54:58.702796 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.702806 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.702858 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.703287 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.703289 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.703291 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:58.703354 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.703356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.704785 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.704786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.706074 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.706078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.707983 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.707984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.708095 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.708101 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.708164 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.708214 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":12,"thread_start_us":83,"threads_started":1}
I20260810 04:54:58.708336 13316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 409b686ae04348b788d8fffed4db11e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:58.708612 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.702218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:37071 (local address 127.0.0.1:56040)
0810 04:54:58.702536 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.702549 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.702615 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.703642 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.703643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.703646 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:58.703690 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.703692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.704695 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.704696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.706074 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.706078 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.708112 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.708113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.708178 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.708187 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.708220 (+ 33us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.708281 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":32,"thread_start_us":66,"threads_started":1}
I20260810 04:54:58.708616 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.702845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56040 (local address 127.15.239.193:37071)
0810 04:54:58.703471 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.703475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.703485 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:54:58.703533 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.703534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.703548 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.703642 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:58.703749 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.704616 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.706183 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.706951 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.708337 (+ 1386us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.708446 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.708479 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.708527 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":115,"threads_started":1}
I20260810 04:54:58.708926 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.702553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49224 (local address 127.15.239.194:38371)
0810 04:54:58.703113 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.703117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.703127 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:54:58.703165 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.703166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.703179 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.703285 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:58.703448 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.704566 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.707067 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.707817 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.707910 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.708008 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.708765 (+ 757us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.708823 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":146,"threads_started":1}
I20260810 04:54:58.709502 12905 tablet_service.cc:1467] Processing CreateTablet for tablet 409b686ae04348b788d8fffed4db11e2 (DEFAULT_TABLE table=test-table [id=71bac5ae8485462485f07999b04581d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:58.709587 13101 tablet_service.cc:1467] Processing CreateTablet for tablet 409b686ae04348b788d8fffed4db11e2 (DEFAULT_TABLE table=test-table [id=71bac5ae8485462485f07999b04581d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:54:58.709908 13101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 409b686ae04348b788d8fffed4db11e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:58.709934 12905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 409b686ae04348b788d8fffed4db11e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:54:58.711841 13429 tablet_bootstrap.cc:492] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Bootstrap starting.
I20260810 04:54:58.712671 13429 tablet_bootstrap.cc:654] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:58.713025 13429 log.cc:824] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:58.713951 13434 tablet_bootstrap.cc:492] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Bootstrap starting.
I20260810 04:54:58.714021 13429 tablet_bootstrap.cc:492] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: No bootstrap required, opened a new log
I20260810 04:54:58.714102 13429 ts_tablet_manager.cc:1397] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:54:58.714597 13434 tablet_bootstrap.cc:654] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:58.714926 13434 log.cc:824] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:58.715315 13435 tablet_bootstrap.cc:492] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: Bootstrap starting.
I20260810 04:54:58.715744 13434 tablet_bootstrap.cc:492] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: No bootstrap required, opened a new log
I20260810 04:54:58.715819 13434 ts_tablet_manager.cc:1397] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:54:58.716084 13435 tablet_bootstrap.cc:654] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: Neither blocks nor log segments found. Creating new log.
I20260810 04:54:58.716473 13435 log.cc:824] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: Log is configured to *not* fsync() on all Append() calls
I20260810 04:54:58.716511 13429 raft_consensus.cc:348] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.716734 13429 raft_consensus.cc:374] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:58.716786 13429 raft_consensus.cc:729] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c13827f2d61421c9ec340318e2f7fd3, State: Initialized, Role: FOLLOWER
I20260810 04:54:58.716959 13429 consensus_queue.cc:260] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.717288 13429 ts_tablet_manager.cc:1428] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:54:58.717458 13409 heartbeater.cc:503] Master 127.15.239.254:43051 was elected leader, sending a full tablet report...
I20260810 04:54:58.717481 13435 tablet_bootstrap.cc:492] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: No bootstrap required, opened a new log
I20260810 04:54:58.717540 13435 ts_tablet_manager.cc:1397] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:54:58.718775 13434 raft_consensus.cc:348] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.718979 13434 raft_consensus.cc:374] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:58.719020 13434 raft_consensus.cc:729] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4666b36fe2894e8d8fac85dde9afc106, State: Initialized, Role: FOLLOWER
I20260810 04:54:58.719156 13434 consensus_queue.cc:260] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.719434 13434 ts_tablet_manager.cc:1428] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 04:54:58.719496 13206 heartbeater.cc:503] Master 127.15.239.254:43051 was elected leader, sending a full tablet report...
I20260810 04:54:58.720248 13435 raft_consensus.cc:348] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.720378 13435 raft_consensus.cc:374] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:54:58.720429 13435 raft_consensus.cc:729] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6771e09c3ec146e3b4c8847ac7eaa7fd, State: Initialized, Role: FOLLOWER
I20260810 04:54:58.720570 13435 consensus_queue.cc:260] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.720836 13435 ts_tablet_manager.cc:1428] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260810 04:54:58.720925 13004 heartbeater.cc:503] Master 127.15.239.254:43051 was elected leader, sending a full tablet report...
W20260810 04:54:58.769531 13207 tablet.cc:2369] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:54:58.849710 13439 raft_consensus.cc:482] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:54:58.849905 13439 raft_consensus.cc:504] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.850389 13439 leader_election.cc:288] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6771e09c3ec146e3b4c8847ac7eaa7fd (127.15.239.193:37071), 4666b36fe2894e8d8fac85dde9afc106 (127.15.239.194:38371)
I20260810 04:54:58.853763 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.850593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:37071 (local address 127.15.239.195:57815)
0810 04:54:58.850673 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.850687 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.850737 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.850935 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.850936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.850938 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:58.851029 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.851032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.851761 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.851762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.852822 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.852825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.853433 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.853434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.853523 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.853527 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.853595 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.853649 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":3}
I20260810 04:54:58.853747 13424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.850758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:59575 (local address 127.15.239.194:38371)
0810 04:54:58.850824 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.850826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.850975 (+ 149us) server_negotiation.cc:407] Connection header received
0810 04:54:58.851061 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.851062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.851073 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.851139 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:58.851321 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.851807 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.852941 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.853342 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.853436 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.853445 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.853606 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.853652 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:54:58.853747 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.850697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:57815 (local address 127.15.239.193:37071)
0810 04:54:58.850765 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.850767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.850780 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:54:58.850820 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.850821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.850837 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.850916 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:54:58.851119 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.851668 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.852939 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.853330 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.853426 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.853438 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.853604 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.853651 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:54:58.853782 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.850633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:38371 (local address 127.15.239.195:59575)
0810 04:54:58.850891 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.850907 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:54:58.850978 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:54:58.851142 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:54:58.851143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:54:58.851145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:54:58.851229 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.851230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.851912 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.851913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.852832 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:54:58.852834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.853436 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.853437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:54:58.853521 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.853530 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 04:54:58.853600 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 04:54:58.853646 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":2,"thread_start_us":177,"threads_started":1}
I20260810 04:54:58.854321 13138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "409b686ae04348b788d8fffed4db11e2" candidate_uuid: "7c13827f2d61421c9ec340318e2f7fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4666b36fe2894e8d8fac85dde9afc106" is_pre_election: true
I20260810 04:54:58.854372 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "409b686ae04348b788d8fffed4db11e2" candidate_uuid: "7c13827f2d61421c9ec340318e2f7fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" is_pre_election: true
I20260810 04:54:58.854563 13138 raft_consensus.cc:2454] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c13827f2d61421c9ec340318e2f7fd3 in term 0.
I20260810 04:54:58.854563 12936 raft_consensus.cc:2454] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c13827f2d61421c9ec340318e2f7fd3 in term 0.
I20260810 04:54:58.854867 13236 leader_election.cc:302] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6771e09c3ec146e3b4c8847ac7eaa7fd, 7c13827f2d61421c9ec340318e2f7fd3; no voters:
I20260810 04:54:58.855019 13439 raft_consensus.cc:2781] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:54:58.855110 13439 raft_consensus.cc:482] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:54:58.855149 13439 raft_consensus.cc:3037] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:58.856094 13439 raft_consensus.cc:504] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.856280 13439 leader_election.cc:288] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [CANDIDATE]: Term 1 election: Requested vote from peers 6771e09c3ec146e3b4c8847ac7eaa7fd (127.15.239.193:37071), 4666b36fe2894e8d8fac85dde9afc106 (127.15.239.194:38371)
I20260810 04:54:58.856455 13138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "409b686ae04348b788d8fffed4db11e2" candidate_uuid: "7c13827f2d61421c9ec340318e2f7fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4666b36fe2894e8d8fac85dde9afc106"
I20260810 04:54:58.856498 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "409b686ae04348b788d8fffed4db11e2" candidate_uuid: "7c13827f2d61421c9ec340318e2f7fd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd"
I20260810 04:54:58.856562 13138 raft_consensus.cc:3037] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:58.856617 12936 raft_consensus.cc:3037] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:54:58.857517 13138 raft_consensus.cc:2454] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c13827f2d61421c9ec340318e2f7fd3 in term 1.
I20260810 04:54:58.857517 12936 raft_consensus.cc:2454] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c13827f2d61421c9ec340318e2f7fd3 in term 1.
I20260810 04:54:58.857714 13239 leader_election.cc:302] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4666b36fe2894e8d8fac85dde9afc106, 7c13827f2d61421c9ec340318e2f7fd3; no voters:
I20260810 04:54:58.857841 13439 raft_consensus.cc:2781] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:54:58.858037 13439 raft_consensus.cc:686] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 1 LEADER]: Becoming Leader. State: Replica: 7c13827f2d61421c9ec340318e2f7fd3, State: Running, Role: LEADER
I20260810 04:54:58.858165 13439 consensus_queue.cc:237] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } }
I20260810 04:54:58.859292 12725 catalog_manager.cc:5495] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c13827f2d61421c9ec340318e2f7fd3 (127.15.239.195). New cstate: current_term: 1 leader_uuid: "7c13827f2d61421c9ec340318e2f7fd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c13827f2d61421c9ec340318e2f7fd3" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 34345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 } health_report { overall_health: UNKNOWN } } }
W20260810 04:54:58.867825 13005 tablet.cc:2369] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:54:58.890952 13423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.887959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.15.239.195:34345)
0810 04:54:58.888057 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 04:54:58.888060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:54:58.888072 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:54:58.888128 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:54:58.888129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:54:58.888156 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:54:58.888228 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:54:58.888456 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.889096 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.890038 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:54:58.890256 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:54:58.890329 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:54:58.890492 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:54:58.890608 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:54:58.890739 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 04:54:58.890826 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 04:54:58.890837 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:54:58.893823 12936 raft_consensus.cc:1261] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 1 FOLLOWER]: Refusing update from remote peer 7c13827f2d61421c9ec340318e2f7fd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:58.893823 13138 raft_consensus.cc:1261] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 1 FOLLOWER]: Refusing update from remote peer 7c13827f2d61421c9ec340318e2f7fd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:54:58.894320 13445 consensus_queue.cc:1035] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6771e09c3ec146e3b4c8847ac7eaa7fd" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 37071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:58.894500 13439 consensus_queue.cc:1035] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4666b36fe2894e8d8fac85dde9afc106" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 38371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:54:58.898574 13453 mvcc.cc:205] Tried to move back new op lower bound from 7316839214664249344 to 7316839214524026880. Current Snapshot: MvccSnapshot[applied={T|T < 7316839214664249344 or (T in {7316839214664249344})}]
I20260810 04:54:58.899592 13452 mvcc.cc:205] Tried to move back new op lower bound from 7316839214664249344 to 7316839214524026880. Current Snapshot: MvccSnapshot[applied={T|T < 7316839214664249344 or (T in {7316839214664249344})}]
I20260810 04:54:58.901037 12726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:58.901160 12726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:54:58.902263 12726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9ce37503f1248668917dc5f494e7311: Sending DeleteTablet for 3 replicas of tablet 409b686ae04348b788d8fffed4db11e2
I20260810 04:54:58.902705 12905 tablet_service.cc:1514] Processing DeleteTablet for tablet 409b686ae04348b788d8fffed4db11e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:58 UTC) from {username='slave'} at 127.0.0.1:56040
I20260810 04:54:58.902855 13316 tablet_service.cc:1514] Processing DeleteTablet for tablet 409b686ae04348b788d8fffed4db11e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:58 UTC) from {username='slave'} at 127.0.0.1:51886
I20260810 04:54:58.903026 13465 tablet_replica.cc:330] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd: stopping tablet replica
I20260810 04:54:58.903163 13465 raft_consensus.cc:2229] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:54:58.903172 13101 tablet_service.cc:1514] Processing DeleteTablet for tablet 409b686ae04348b788d8fffed4db11e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:54:58 UTC) from {username='slave'} at 127.0.0.1:49224
I20260810 04:54:58.903287 13465 raft_consensus.cc:2258] T 409b686ae04348b788d8fffed4db11e2 P 6771e09c3ec146e3b4c8847ac7eaa7fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:58.903194 13467 tablet_replica.cc:330] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: stopping tablet replica
I20260810 04:54:58.903487 13467 raft_consensus.cc:2229] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:54:58.903654 13467 raft_consensus.cc:2258] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:58.903679 13468 tablet_replica.cc:330] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: stopping tablet replica
I20260810 04:54:58.903714 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 12811
I20260810 04:54:58.917650 13467 ts_tablet_manager.cc:1905] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:58.919903 13467 ts_tablet_manager.cc:1918] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:54:58.920009 13467 log.cc:1196] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/409b686ae04348b788d8fffed4db11e2
I20260810 04:54:58.920358 13467 ts_tablet_manager.cc:1939] T 409b686ae04348b788d8fffed4db11e2 P 7c13827f2d61421c9ec340318e2f7fd3: Deleting consensus metadata
I20260810 04:54:58.920945 12709 catalog_manager.cc:4841] TS 7c13827f2d61421c9ec340318e2f7fd3 (127.15.239.195:34345): tablet 409b686ae04348b788d8fffed4db11e2 (table test-table [id=71bac5ae8485462485f07999b04581d2]) successfully deleted
I20260810 04:54:58.903780 13468 raft_consensus.cc:2229] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 04:54:58.923555 12704 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:37071 (error 108)
I20260810 04:54:58.923837 13468 raft_consensus.cc:2258] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:54:58.924559 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.924382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:37071 (local address 127.0.0.1:56050)
0810 04:54:58.924456 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.924510 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:37071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 04:54:58.924568 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 13007
W20260810 04:54:58.924710 12704 catalog_manager.cc:4584] TS 6771e09c3ec146e3b4c8847ac7eaa7fd (127.15.239.193:37071): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 409b686ae04348b788d8fffed4db11e2: Network error: Client connection negotiation failed: client connection to 127.15.239.193:37071: connect: Connection refused (error 111)
I20260810 04:54:58.924588 13468 ts_tablet_manager.cc:1905] T 409b686ae04348b788d8fffed4db11e2 P 4666b36fe2894e8d8fac85dde9afc106: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:54:58.947372 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 13210
I20260810 04:54:58.958632 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:54:58.958420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:38371 (local address 127.0.0.1:49230)
0810 04:54:58.958509 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0810 04:54:58.958552 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.194:38371: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 04:54:58.964481 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 12680
2026-08-10T04:54:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1027 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:54:59 dist-test-slave-kvfs krb5kdc[13472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:54:59 dist-test-slave-kvfs krb5kdc[13472](info): set up 2 sockets
Aug 10 04:54:59 dist-test-slave-kvfs krb5kdc[13472](info): commencing operation
krb5kdc: starting...
W20260810 04:55:00.264847 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:00 dist-test-slave-kvfs krb5kdc[13472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:00.411787 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:46829
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:46829
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:00.509130 13492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:00.509454 13492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:00.509496 13492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:00.510766 13492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:00.510841 13492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:00.510865 13492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:00.510902 13492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:00.510933 13492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:00.512601 13492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:46829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:46829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:00.512953 13492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:00.513242 13492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:00.519204 13498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:00.519274 13502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:00.519235 13505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:00.519500 13492 server_base.cc:1034] running on GCE node
I20260810 04:55:00.520056 13492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:00.520478 13492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:00.521661 13492 hybrid_clock.cc:648] HybridClock initialized: now 1786337700521634 us; error 42 us; skew 500 ppm
Aug 10 04:55:00 dist-test-slave-kvfs krb5kdc[13472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:00.524832 13492 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:00.525357 13492 webserver.cc:460] Webserver started at http://127.15.239.254:37661/ using document root <none> and password file <none>
I20260810 04:55:00.525645 13492 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:00.525719 13492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:00.525887 13492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:00.527141 13492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "a2af366ec7584d45a68084684fbc5f7e"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "fa6f7ec7a7a377c7f2f889119706437c"
server_key_iv: "b7c411956d4427e690905c9e376e9e88"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.527582 13492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "a2af366ec7584d45a68084684fbc5f7e"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "fa6f7ec7a7a377c7f2f889119706437c"
server_key_iv: "b7c411956d4427e690905c9e376e9e88"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.529330 13492 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 04:55:00.530359 13515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:00.530618 13492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:00.530753 13492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "a2af366ec7584d45a68084684fbc5f7e"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "fa6f7ec7a7a377c7f2f889119706437c"
server_key_iv: "b7c411956d4427e690905c9e376e9e88"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.530870 13492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:00.544348 13492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:00.547142 13492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:00.547359 13492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:00.553282 13492 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:46829
I20260810 04:55:00.553342 13606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:46829 every 8 connection(s)
I20260810 04:55:00.553807 13492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:00.555099 13607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:00.558161 13607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e: Bootstrap starting.
I20260810 04:55:00.558914 13607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:00.559213 13607 log.cc:824] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:00.559576 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 13492
I20260810 04:55:00.559716 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:00.559975 16319 external_mini_cluster.cc:1428] Setting key d04554ed8d895dedd8d2a33bbd2c6956
I20260810 04:55:00.560277 13607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e: No bootstrap required, opened a new log
I20260810 04:55:00.562439 13607 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2af366ec7584d45a68084684fbc5f7e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46829 } }
I20260810 04:55:00.562616 13607 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:00.562640 13607 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2af366ec7584d45a68084684fbc5f7e, State: Initialized, Role: FOLLOWER
I20260810 04:55:00.562847 13607 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2af366ec7584d45a68084684fbc5f7e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46829 } }
I20260810 04:55:00.562963 13607 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:00.563004 13607 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:00.563057 13607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:00.564478 13607 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2af366ec7584d45a68084684fbc5f7e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46829 } }
I20260810 04:55:00.564599 13607 leader_election.cc:302] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2af366ec7584d45a68084684fbc5f7e; no voters:
I20260810 04:55:00.564851 13607 leader_election.cc:288] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:00.564895 13614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:00.565071 13614 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [term 1 LEADER]: Becoming Leader. State: Replica: a2af366ec7584d45a68084684fbc5f7e, State: Running, Role: LEADER
I20260810 04:55:00.565217 13607 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:00.565184 13614 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2af366ec7584d45a68084684fbc5f7e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46829 } }
I20260810 04:55:00.565650 13616 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2af366ec7584d45a68084684fbc5f7e. Latest consensus state: current_term: 1 leader_uuid: "a2af366ec7584d45a68084684fbc5f7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2af366ec7584d45a68084684fbc5f7e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46829 } } }
I20260810 04:55:00.565654 13615 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2af366ec7584d45a68084684fbc5f7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2af366ec7584d45a68084684fbc5f7e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 46829 } } }
I20260810 04:55:00.565891 13615 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:00.565840 13616 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:00.566362 13623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:00.567078 13623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:00.569263 13623 catalog_manager.cc:1347] Generated new cluster ID: ac08ee508d344b728eda91ce17eb12e0
I20260810 04:55:00.569324 13623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:55:00 dist-test-slave-kvfs krb5kdc[13472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:00.574123 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:00.560776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38880 (local address 127.15.239.254:46829)
0810 04:55:00.561018 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:00.561036 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:00.561068 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:55:00.562429 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:00.562441 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:00.562514 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:00.562737 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:00.563737 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:00.565122 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:00.566338 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:00.567064 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:00.567182 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:00.570371 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:00.570377 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:00.570377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:00.570394 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:00.572348 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:00.572738 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:00.572742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:00.572742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:00.572879 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:00.573115 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:00.573116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:00.573117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:00.573412 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:00.573596 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:00.573716 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 04:55:00.573880 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":109,"threads_started":1}
I20260810 04:55:00.597466 13623 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:00.598486 13623 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:00.602463 13623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e: Generated new TSK 0
I20260810 04:55:00.602700 13623 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.239.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
Entry for principal kudu/127.15.239.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab.
I20260810 04:55:00.647794 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:46829
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:00.753592 13644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:00.753958 13644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:00.754007 13644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:00.756245 13644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:00.756318 13644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:00.756369 13644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:55:00.759050 13644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.193.keytab
--principal=kudu/127.15.239.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:46829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:00.762193 13644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:00.764647 13644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:00.771638 13654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:00.771651 13659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:00.771709 13653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:00.771732 13644 server_base.cc:1034] running on GCE node
I20260810 04:55:00.772156 13644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:00.772469 13644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:00.773646 13644 hybrid_clock.cc:648] HybridClock initialized: now 1786337700773635 us; error 44 us; skew 500 ppm
Aug 10 04:55:00 dist-test-slave-kvfs krb5kdc[13472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:00.776755 13644 init.cc:377] Logged in from keytab as kudu/127.15.239.193@KRBTEST.COM (short username kudu)
I20260810 04:55:00.777276 13644 webserver.cc:460] Webserver started at http://127.15.239.193:43015/ using document root <none> and password file <none>
I20260810 04:55:00.777580 13644 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:00.777660 13644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:00.777828 13644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:00.779110 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "075d8ca5fc3c4cfdab0d00571b89546f"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "2a61027913414dbb5f6f224881855e8a"
server_key_iv: "ff92ef1cb2dc02c2447a7e683ae4d0ba"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.779538 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "075d8ca5fc3c4cfdab0d00571b89546f"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "2a61027913414dbb5f6f224881855e8a"
server_key_iv: "ff92ef1cb2dc02c2447a7e683ae4d0ba"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.781126 13644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:55:00.781953 13666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:00.782143 13644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 04:55:00.782251 13644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "075d8ca5fc3c4cfdab0d00571b89546f"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "2a61027913414dbb5f6f224881855e8a"
server_key_iv: "ff92ef1cb2dc02c2447a7e683ae4d0ba"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.782333 13644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:00.807899 13644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:00.810494 13644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:00.810704 13644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:00.811045 13644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:55:00.811455 13644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:55:00.811514 13644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:00.811565 13644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:55:00.811591 13644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:00.819218 13644 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:44617
I20260810 04:55:00.819271 13835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:44617 every 8 connection(s)
I20260810 04:55:00.819689 13644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
Aug 10 04:55:00 dist-test-slave-kvfs krb5kdc[13472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.193@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:00.827061 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 13644
I20260810 04:55:00.827165 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:55:00.827417 16319 external_mini_cluster.cc:1428] Setting key 004b2853396b679175450862abaf74a0
I20260810 04:55:00.830780 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:00.820656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:36347 (local address 127.15.239.254:46829)
0810 04:55:00.820736 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:00.820738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:00.820960 (+ 222us) server_negotiation.cc:407] Connection header received
0810 04:55:00.821563 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:00.821564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:00.821579 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:00.821646 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:00.822775 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:00.823369 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:00.824458 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:00.824677 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:00.824734 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:00.827307 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:00.827309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:00.827310 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:00.827317 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:00.829118 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:00.829625 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:00.829627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:00.829628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:00.829704 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:00.829994 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:00.829996 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:00.829996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:00.830135 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:00.830215 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:00.830553 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 04:55:00.830672 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 04:55:00.831002 13839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:00.820598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46829 (local address 127.15.239.193:36347)
0810 04:55:00.820799 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:00.820852 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:00.821461 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:00.821741 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:00.821746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:00.822436 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:00.822689 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:00.822694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:00.823459 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:00.823459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:00.824385 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:00.824388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:00.824755 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:00.824757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:00.824872 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:00.825467 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:00.825476 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:00.827137 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:00.829241 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:00.829251 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:00.829254 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:00.829540 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:00.829779 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:00.829780 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:00.829781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:00.829915 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:00.830205 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:00.830213 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:00.830388 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 04:55:00.830517 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 04:55:00.830708 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":109,"threads_started":1}
I20260810 04:55:00.831602 13836 heartbeater.cc:347] Connected to a master server at 127.15.239.254:46829
I20260810 04:55:00.831734 13836 heartbeater.cc:464] Registering TS with master...
I20260810 04:55:00.831965 13836 heartbeater.cc:511] Master 127.15.239.254:46829 requested a full tablet report, sending...
I20260810 04:55:00.832892 13550 ts_manager.cc:194] Registered new tserver with Master: 075d8ca5fc3c4cfdab0d00571b89546f (127.15.239.193:44617)
I20260810 04:55:00.833940 13550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.193@KRBTEST.COM'} at 127.15.239.193:36347
WARNING: no policy specified for kudu/127.15.239.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
Entry for principal kudu/127.15.239.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab.
I20260810 04:55:00.860476 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:46829
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:00.959318 13842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:00.959573 13842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:00.959599 13842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:00.960877 13842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:00.960930 13842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:00.960958 13842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:55:00.962572 13842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.194.keytab
--principal=kudu/127.15.239.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:46829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:00.962884 13842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:00.963205 13842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:00.969851 13851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:00.969882 13853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:00.969923 13842 server_base.cc:1034] running on GCE node
W20260810 04:55:00.969882 13859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:00.970443 13842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:00.970742 13842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:00.971963 13842 hybrid_clock.cc:648] HybridClock initialized: now 1786337700971941 us; error 46 us; skew 500 ppm
Aug 10 04:55:00 dist-test-slave-kvfs krb5kdc[13472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:00.975322 13842 init.cc:377] Logged in from keytab as kudu/127.15.239.194@KRBTEST.COM (short username kudu)
I20260810 04:55:00.975862 13842 webserver.cc:460] Webserver started at http://127.15.239.194:39143/ using document root <none> and password file <none>
I20260810 04:55:00.976250 13842 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:00.976308 13842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:00.976505 13842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:00.977854 13842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "71c4a0abcc70425bbcdf7544bb5627c8"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "4b50c3d22fc64ce559f71382d0f31921"
server_key_iv: "f4dc6d2230573d779301c8a02c25f395"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.978293 13842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "71c4a0abcc70425bbcdf7544bb5627c8"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "4b50c3d22fc64ce559f71382d0f31921"
server_key_iv: "f4dc6d2230573d779301c8a02c25f395"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.980162 13842 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 04:55:00.981175 13868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:00.981433 13842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:00.981554 13842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "71c4a0abcc70425bbcdf7544bb5627c8"
format_stamp: "Formatted at 2026-08-10 04:55:00 on dist-test-slave-kvfs"
server_key: "4b50c3d22fc64ce559f71382d0f31921"
server_key_iv: "f4dc6d2230573d779301c8a02c25f395"
server_key_version: "encryptionkey@0"
I20260810 04:55:00.981649 13842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:00.996712 13842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:00.999476 13842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:00.999656 13842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:00.999990 13842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:55:01.000510 13842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:55:01.000550 13842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.000576 13842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:55:01.000588 13842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.008087 13842 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:36017
I20260810 04:55:01.008168 14056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:36017 every 8 connection(s)
I20260810 04:55:01.008584 13842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
Aug 10 04:55:01 dist-test-slave-kvfs krb5kdc[13472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337700, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.194@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:01.018648 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 13842
I20260810 04:55:01.018757 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:55:01.019049 16319 external_mini_cluster.cc:1428] Setting key 617ae9f805ec66cf73dd39a8fad9330b
I20260810 04:55:01.019851 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.009590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:49295 (local address 127.15.239.254:46829)
0810 04:55:01.009683 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.009686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.009932 (+ 246us) server_negotiation.cc:407] Connection header received
0810 04:55:01.010562 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.010563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.010576 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.010634 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:01.011731 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.012333 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.013434 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.013644 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.013698 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.016284 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:01.016286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:01.016286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:01.016293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:01.017981 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:01.018517 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:01.018519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:01.018520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:01.018594 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:01.018972 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:01.018973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:01.018973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:01.019123 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:01.019216 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.019604 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.019744 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 04:55:01.020112 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.009541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46829 (local address 127.15.239.194:49295)
0810 04:55:01.009786 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.009833 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.010460 (+ 627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.010699 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.010703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.011398 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:01.011645 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.011650 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.012437 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.012439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.013353 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.013356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.013725 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.013727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.013867 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.014472 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:01.014483 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:01.016174 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:01.018097 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:01.018105 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:01.018108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:01.018411 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:01.018690 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:01.018691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:01.018692 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:01.018902 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:01.019222 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:01.019231 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:01.019426 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.019562 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.019771 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":121,"threads_started":1}
I20260810 04:55:01.020663 14058 heartbeater.cc:347] Connected to a master server at 127.15.239.254:46829
I20260810 04:55:01.020789 14058 heartbeater.cc:464] Registering TS with master...
I20260810 04:55:01.021049 14058 heartbeater.cc:511] Master 127.15.239.254:46829 requested a full tablet report, sending...
I20260810 04:55:01.021521 13550 ts_manager.cc:194] Registered new tserver with Master: 71c4a0abcc70425bbcdf7544bb5627c8 (127.15.239.194:36017)
I20260810 04:55:01.021965 13550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.194@KRBTEST.COM'} at 127.15.239.194:49295
WARNING: no policy specified for kudu/127.15.239.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
Entry for principal kudu/127.15.239.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab.
I20260810 04:55:01.051795 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:46829
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:42767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:01.149453 14066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:01.149708 14066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:01.149731 14066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:01.151012 14066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:01.151063 14066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:01.151091 14066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:55:01.152683 14066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:42767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.195.keytab
--principal=kudu/127.15.239.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:46829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:01.152976 14066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:01.153270 14066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:01.159330 14075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:01.159276 14072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:01.159284 14071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:01.159315 14066 server_base.cc:1034] running on GCE node
I20260810 04:55:01.159859 14066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:01.160194 14066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:01.161366 14066 hybrid_clock.cc:648] HybridClock initialized: now 1786337701161348 us; error 32 us; skew 500 ppm
Aug 10 04:55:01 dist-test-slave-kvfs krb5kdc[13472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337701, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:01.164417 14066 init.cc:377] Logged in from keytab as kudu/127.15.239.195@KRBTEST.COM (short username kudu)
I20260810 04:55:01.164937 14066 webserver.cc:460] Webserver started at http://127.15.239.195:37379/ using document root <none> and password file <none>
I20260810 04:55:01.165259 14066 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:01.165333 14066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:01.165581 14066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:01.166977 14066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "9f4ff96f743a48518cff973698230292"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "b1d2696af84d81f44601ee92a60c8376"
server_key_iv: "9c527c51b2cc491c820624f1062cd445"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.167387 14066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "9f4ff96f743a48518cff973698230292"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "b1d2696af84d81f44601ee92a60c8376"
server_key_iv: "9c527c51b2cc491c820624f1062cd445"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.169054 14066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:55:01.169956 14086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.170183 14066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:01.170305 14066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "9f4ff96f743a48518cff973698230292"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "b1d2696af84d81f44601ee92a60c8376"
server_key_iv: "9c527c51b2cc491c820624f1062cd445"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.170385 14066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:01.193091 14066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:01.195890 14066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:01.196099 14066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:01.196431 14066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:55:01.196837 14066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:55:01.196874 14066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.196904 14066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:55:01.196916 14066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.204504 14066 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:33871
I20260810 04:55:01.204589 14278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:33871 every 8 connection(s)
I20260810 04:55:01.205009 14066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:55:01.210151 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 14066
I20260810 04:55:01.210258 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:55:01.210532 16319 external_mini_cluster.cc:1428] Setting key 9bf84340d267abde6c2bc4b88c26a95c
Aug 10 04:55:01 dist-test-slave-kvfs krb5kdc[13472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337701, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.195@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:01.216241 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.205977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:49913 (local address 127.15.239.254:46829)
0810 04:55:01.206090 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.206093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.206328 (+ 235us) server_negotiation.cc:407] Connection header received
0810 04:55:01.207022 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.207023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.207040 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.207105 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:01.208446 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.209032 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.210196 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.210468 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.210552 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.213197 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:01.213199 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:01.213200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:01.213208 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:01.214612 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:01.215102 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:01.215103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:01.215104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:01.215174 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:01.215444 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:01.215446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:01.215446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:01.215585 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:01.215664 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.216000 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.216136 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:55:01.216450 14284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.205880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:46829 (local address 127.15.239.195:49913)
0810 04:55:01.206157 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.206213 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.206879 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.207211 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.207217 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.207979 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:01.208319 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.208326 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.209143 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.209144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.210090 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.210093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.210575 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.210576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.210725 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.211385 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:01.211396 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:01.213091 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:01.214750 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:01.214758 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:01.214761 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:01.215019 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:01.215248 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:01.215249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:01.215249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:01.215373 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:01.215663 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:01.215671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:01.215850 (+ 179us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.215964 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.216180 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":121,"threads_started":1}
I20260810 04:55:01.217038 14281 heartbeater.cc:347] Connected to a master server at 127.15.239.254:46829
I20260810 04:55:01.217199 14281 heartbeater.cc:464] Registering TS with master...
I20260810 04:55:01.217453 14281 heartbeater.cc:511] Master 127.15.239.254:46829 requested a full tablet report, sending...
I20260810 04:55:01.217929 13550 ts_manager.cc:194] Registered new tserver with Master: 9f4ff96f743a48518cff973698230292 (127.15.239.195:33871)
I20260810 04:55:01.218367 13550 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.195@KRBTEST.COM'} at 127.15.239.195:49913
I20260810 04:55:01.222560 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:55:01.230810 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.224291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38896 (local address 127.15.239.254:46829)
0810 04:55:01.224359 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.224361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.224513 (+ 152us) server_negotiation.cc:407] Connection header received
0810 04:55:01.224557 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.224558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.224568 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.224622 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:01.225235 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.225766 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.226508 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.226700 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.226755 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.228077 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:01.228079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:01.228080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:01.228088 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:01.229526 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:01.229906 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:01.229907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:01.229908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:01.229973 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:01.230187 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:01.230188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:01.230189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:01.230403 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:01.230503 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.230605 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.230675 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 04:55:01.232832 13550 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:55:01.235044 13550 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:55:01.243302 14306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.238498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:44617 (local address 127.0.0.1:57008)
0810 04:55:01.238999 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.239007 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.239097 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.239313 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.239314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.239317 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:01.239384 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.239387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.240476 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.240477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.241787 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.241790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.242931 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.242932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.243039 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.243054 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.243126 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.243204 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":4,"thread_start_us":85,"threads_started":1}
I20260810 04:55:01.243326 14304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.238406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59842 (local address 127.15.239.195:33871)
0810 04:55:01.239375 (+ 969us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.239380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.239391 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:55:01.239435 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.239438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.239458 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.239548 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:01.239657 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.240775 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.242043 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.242760 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.242824 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.242891 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.243182 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.243227 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":919,"thread_start_us":128,"threads_started":1}
I20260810 04:55:01.243615 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.238245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:33871 (local address 127.0.0.1:59842)
0810 04:55:01.238467 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.238533 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.238619 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.239554 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.239555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.239557 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:01.239592 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.239594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.240906 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.240907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.241950 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.241952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.242933 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.242934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.243039 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.243053 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.243126 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.243530 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":371,"thread_start_us":101,"threads_started":1}
I20260810 04:55:01.243755 14301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.238247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36017 (local address 127.0.0.1:55290)
0810 04:55:01.238635 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.238645 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.238691 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.239203 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.239207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.239209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:01.239305 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.239307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.241111 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.241112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.242305 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.242308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.243489 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.243490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.243564 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.243567 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.243621 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.243666 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":2,"thread_start_us":83,"threads_started":1}
I20260810 04:55:01.243806 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.238693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.15.239.194:36017)
0810 04:55:01.238959 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.238964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.238988 (+ 24us) server_negotiation.cc:407] Connection header received
0810 04:55:01.239040 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.239043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.239064 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.239172 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:01.239399 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.241004 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.242418 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.243363 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.243483 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.243545 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.243635 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.243692 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":106,"threads_started":1}
I20260810 04:55:01.244248 14307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.238672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57008 (local address 127.15.239.193:44617)
0810 04:55:01.238949 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.238954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.239087 (+ 133us) server_negotiation.cc:407] Connection header received
0810 04:55:01.239175 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.239177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.239196 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.239310 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:01.239448 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.240371 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.241896 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.242716 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.242815 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.242891 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.244093 (+ 1202us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.244150 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":127,"threads_started":1}
I20260810 04:55:01.244614 14159 tablet_service.cc:1467] Processing CreateTablet for tablet 3fc6370fd6984688a55b88f9e74a85be (DEFAULT_TABLE table=test-table [id=4eca2dfd9e344e62aa3d9827e64cc545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:55:01.244948 13735 tablet_service.cc:1467] Processing CreateTablet for tablet 3fc6370fd6984688a55b88f9e74a85be (DEFAULT_TABLE table=test-table [id=4eca2dfd9e344e62aa3d9827e64cc545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:55:01.245097 14159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fc6370fd6984688a55b88f9e74a85be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:01.245288 13735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fc6370fd6984688a55b88f9e74a85be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:01.249233 14311 tablet_bootstrap.cc:492] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: Bootstrap starting.
I20260810 04:55:01.250197 14311 tablet_bootstrap.cc:654] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:01.250541 13943 tablet_service.cc:1467] Processing CreateTablet for tablet 3fc6370fd6984688a55b88f9e74a85be (DEFAULT_TABLE table=test-table [id=4eca2dfd9e344e62aa3d9827e64cc545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:55:01.250797 14311 log.cc:824] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:01.250954 13943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fc6370fd6984688a55b88f9e74a85be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:01.251276 14309 tablet_bootstrap.cc:492] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Bootstrap starting.
I20260810 04:55:01.251901 14309 tablet_bootstrap.cc:654] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:01.252462 14311 tablet_bootstrap.cc:492] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: No bootstrap required, opened a new log
I20260810 04:55:01.252440 14309 log.cc:824] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:01.252586 14311 ts_tablet_manager.cc:1397] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:55:01.253356 14309 tablet_bootstrap.cc:492] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: No bootstrap required, opened a new log
I20260810 04:55:01.253448 14309 ts_tablet_manager.cc:1397] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 04:55:01.254848 14314 tablet_bootstrap.cc:492] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Bootstrap starting.
I20260810 04:55:01.254894 14311 raft_consensus.cc:348] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.255146 14311 raft_consensus.cc:374] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:01.255191 14311 raft_consensus.cc:729] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 075d8ca5fc3c4cfdab0d00571b89546f, State: Initialized, Role: FOLLOWER
I20260810 04:55:01.255190 14309 raft_consensus.cc:348] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.255389 14309 raft_consensus.cc:374] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:01.255343 14311 consensus_queue.cc:260] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.255434 14309 raft_consensus.cc:729] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4ff96f743a48518cff973698230292, State: Initialized, Role: FOLLOWER
I20260810 04:55:01.255609 14314 tablet_bootstrap.cc:654] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:01.255578 14309 consensus_queue.cc:260] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.255703 14311 ts_tablet_manager.cc:1428] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:55:01.255810 13836 heartbeater.cc:503] Master 127.15.239.254:46829 was elected leader, sending a full tablet report...
I20260810 04:55:01.256425 14314 log.cc:824] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:01.256829 14281 heartbeater.cc:503] Master 127.15.239.254:46829 was elected leader, sending a full tablet report...
I20260810 04:55:01.257164 14309 ts_tablet_manager.cc:1428] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260810 04:55:01.257534 14314 tablet_bootstrap.cc:492] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: No bootstrap required, opened a new log
I20260810 04:55:01.257611 14314 ts_tablet_manager.cc:1397] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 04:55:01.259282 14314 raft_consensus.cc:348] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.259460 14314 raft_consensus.cc:374] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:01.259485 14314 raft_consensus.cc:729] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71c4a0abcc70425bbcdf7544bb5627c8, State: Initialized, Role: FOLLOWER
I20260810 04:55:01.259605 14314 consensus_queue.cc:260] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.259894 14314 ts_tablet_manager.cc:1428] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:55:01.260073 14058 heartbeater.cc:503] Master 127.15.239.254:46829 was elected leader, sending a full tablet report...
W20260810 04:55:01.320632 13838 tablet.cc:2369] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:55:01.451588 14315 raft_consensus.cc:482] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:55:01.451807 14315 raft_consensus.cc:504] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.452401 14315 leader_election.cc:288] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71c4a0abcc70425bbcdf7544bb5627c8 (127.15.239.194:36017), 9f4ff96f743a48518cff973698230292 (127.15.239.195:33871)
W20260810 04:55:01.455735 14282 tablet.cc:2369] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:55:01.455881 14325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.452667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:33871 (local address 127.15.239.193:42983)
0810 04:55:01.452956 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.452966 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.453053 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.453220 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.453221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.453223 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:01.453340 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.453342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.454043 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.454044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.454913 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.454916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.455525 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.455525 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.455608 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.455614 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.455690 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.455746 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":20,"thread_start_us":80,"threads_started":1}
I20260810 04:55:01.456099 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.452754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:54869 (local address 127.15.239.194:36017)
0810 04:55:01.452854 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.452857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.452956 (+ 99us) server_negotiation.cc:407] Connection header received
0810 04:55:01.453070 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.453072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.453083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.453159 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:01.453369 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.453930 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.455016 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.455435 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.455527 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.455560 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.455809 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.455858 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 04:55:01.456188 14304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.452792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:42983 (local address 127.15.239.195:33871)
0810 04:55:01.452856 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.452858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.453048 (+ 190us) server_negotiation.cc:407] Connection header received
0810 04:55:01.453123 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.453125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.453137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.453214 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:01.453448 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.453949 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.455019 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.455432 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.455524 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.455538 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.455715 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.455771 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:55:01.455881 14321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.452667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:36017 (local address 127.15.239.193:54869)
0810 04:55:01.452849 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.452863 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.452980 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.453166 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.453167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.453169 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:01.453276 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.453279 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.454032 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.454033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.454912 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.454914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.455528 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.455529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.455619 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.455624 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.455692 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.455743 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":1,"thread_start_us":93,"threads_started":1}
I20260810 04:55:01.456626 14194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fc6370fd6984688a55b88f9e74a85be" candidate_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4ff96f743a48518cff973698230292" is_pre_election: true
I20260810 04:55:01.456976 14194 raft_consensus.cc:2454] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 075d8ca5fc3c4cfdab0d00571b89546f in term 0.
I20260810 04:55:01.456974 13979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fc6370fd6984688a55b88f9e74a85be" candidate_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" is_pre_election: true
I20260810 04:55:01.457165 13979 raft_consensus.cc:2454] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 075d8ca5fc3c4cfdab0d00571b89546f in term 0.
I20260810 04:55:01.457412 13670 leader_election.cc:302] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 075d8ca5fc3c4cfdab0d00571b89546f, 9f4ff96f743a48518cff973698230292; no voters:
I20260810 04:55:01.457650 14315 raft_consensus.cc:2781] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:55:01.457698 14315 raft_consensus.cc:482] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:55:01.457715 14315 raft_consensus.cc:3037] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:01.458606 14315 raft_consensus.cc:504] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.458786 14315 leader_election.cc:288] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [CANDIDATE]: Term 1 election: Requested vote from peers 71c4a0abcc70425bbcdf7544bb5627c8 (127.15.239.194:36017), 9f4ff96f743a48518cff973698230292 (127.15.239.195:33871)
I20260810 04:55:01.458968 13979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fc6370fd6984688a55b88f9e74a85be" candidate_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71c4a0abcc70425bbcdf7544bb5627c8"
I20260810 04:55:01.459069 14194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fc6370fd6984688a55b88f9e74a85be" candidate_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4ff96f743a48518cff973698230292"
I20260810 04:55:01.459118 13979 raft_consensus.cc:3037] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:01.459170 14194 raft_consensus.cc:3037] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:01.460397 14194 raft_consensus.cc:2454] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 075d8ca5fc3c4cfdab0d00571b89546f in term 1.
I20260810 04:55:01.460397 13979 raft_consensus.cc:2454] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 075d8ca5fc3c4cfdab0d00571b89546f in term 1.
I20260810 04:55:01.460587 13670 leader_election.cc:302] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 075d8ca5fc3c4cfdab0d00571b89546f, 9f4ff96f743a48518cff973698230292; no voters:
I20260810 04:55:01.460711 14315 raft_consensus.cc:2781] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:01.460911 14315 raft_consensus.cc:686] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 1 LEADER]: Becoming Leader. State: Replica: 075d8ca5fc3c4cfdab0d00571b89546f, State: Running, Role: LEADER
I20260810 04:55:01.461038 14315 consensus_queue.cc:237] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } }
I20260810 04:55:01.462106 13550 catalog_manager.cc:5495] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f reported cstate change: term changed from 0 to 1, leader changed from <none> to 075d8ca5fc3c4cfdab0d00571b89546f (127.15.239.193). New cstate: current_term: 1 leader_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "075d8ca5fc3c4cfdab0d00571b89546f" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 44617 } health_report { overall_health: HEALTHY } } }
I20260810 04:55:01.477609 14307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.475037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53044 (local address 127.15.239.193:44617)
0810 04:55:01.475108 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.475110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.475118 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:55:01.475168 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.475169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.475191 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.475273 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:01.475422 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.475968 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.476821 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.477033 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.477100 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.477263 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:01.477411 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:01.477493 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.477508 (+ 15us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.477532 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 04:55:01.480090 14194 raft_consensus.cc:1261] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 1 FOLLOWER]: Refusing update from remote peer 075d8ca5fc3c4cfdab0d00571b89546f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:01.480091 13979 raft_consensus.cc:1261] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 1 FOLLOWER]: Refusing update from remote peer 075d8ca5fc3c4cfdab0d00571b89546f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:01.480587 14329 consensus_queue.cc:1035] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f4ff96f743a48518cff973698230292" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:01.480757 14315 consensus_queue.cc:1035] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c4a0abcc70425bbcdf7544bb5627c8" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:01.483695 14336 mvcc.cc:205] Tried to move back new op lower bound from 7316839225258323968 to 7316839225185193984. Current Snapshot: MvccSnapshot[applied={T|T < 7316839225258323968}]
I20260810 04:55:01.483537 14334 mvcc.cc:205] Tried to move back new op lower bound from 7316839225258323968 to 7316839225185193984. Current Snapshot: MvccSnapshot[applied={T|T < 7316839225258323968}]
I20260810 04:55:01.487571 13549 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:55:01.487716 13549 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:55:01.488843 13549 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a2af366ec7584d45a68084684fbc5f7e: Sending DeleteTablet for 3 replicas of tablet 3fc6370fd6984688a55b88f9e74a85be
I20260810 04:55:01.489293 13943 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fc6370fd6984688a55b88f9e74a85be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:55:01 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:55290
I20260810 04:55:01.489300 14159 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fc6370fd6984688a55b88f9e74a85be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:55:01 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:59842
I20260810 04:55:01.489573 13735 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fc6370fd6984688a55b88f9e74a85be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:55:01 UTC) from {username='kudu', principal='kudu/127.15.239.254@KRBTEST.COM'} at 127.0.0.1:57008
I20260810 04:55:01.489796 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 13644
I20260810 04:55:01.489817 14351 tablet_replica.cc:330] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f: stopping tablet replica
I20260810 04:55:01.489830 14345 tablet_replica.cc:330] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: stopping tablet replica
I20260810 04:55:01.489931 14351 raft_consensus.cc:2229] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 1 LEADER]: Raft consensus shutting down.
I20260810 04:55:01.489943 14345 raft_consensus.cc:2229] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:55:01.490062 14345 raft_consensus.cc:2258] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:55:01.490067 14351 raft_consensus.cc:2258] T 3fc6370fd6984688a55b88f9e74a85be P 075d8ca5fc3c4cfdab0d00571b89546f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:55:01.493975 14345 ts_tablet_manager.cc:1905] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:55:01.495075 14346 tablet_replica.cc:330] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: stopping tablet replica
I20260810 04:55:01.495288 14346 raft_consensus.cc:2229] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:55:01.495467 14346 raft_consensus.cc:2258] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:55:01.495893 14345 ts_tablet_manager.cc:1918] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:55:01.495983 14345 log.cc:1196] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/3fc6370fd6984688a55b88f9e74a85be
I20260810 04:55:01.496253 14345 ts_tablet_manager.cc:1939] T 3fc6370fd6984688a55b88f9e74a85be P 71c4a0abcc70425bbcdf7544bb5627c8: Deleting consensus metadata
I20260810 04:55:01.497850 13520 catalog_manager.cc:4841] TS 71c4a0abcc70425bbcdf7544bb5627c8 (127.15.239.194:36017): tablet 3fc6370fd6984688a55b88f9e74a85be (table test-table [id=4eca2dfd9e344e62aa3d9827e64cc545]) successfully deleted
I20260810 04:55:01.498437 14346 ts_tablet_manager.cc:1905] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:55:01.499945 14346 ts_tablet_manager.cc:1918] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:55:01.500013 14346 log.cc:1196] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/3fc6370fd6984688a55b88f9e74a85be
I20260810 04:55:01.500358 14346 ts_tablet_manager.cc:1939] T 3fc6370fd6984688a55b88f9e74a85be P 9f4ff96f743a48518cff973698230292: Deleting consensus metadata
I20260810 04:55:01.500850 13522 catalog_manager.cc:4841] TS 9f4ff96f743a48518cff973698230292 (127.15.239.195:33871): tablet 3fc6370fd6984688a55b88f9e74a85be (table test-table [id=4eca2dfd9e344e62aa3d9827e64cc545]) successfully deleted
W20260810 04:55:01.503937 13520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:44617 (error 108)
I20260810 04:55:01.504302 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 13842
I20260810 04:55:01.523108 14306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.522765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:44617 (local address 127.0.0.1:53046)
0810 04:55:01.522869 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.523024 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260810 04:55:01.523626 13520 catalog_manager.cc:4584] TS 075d8ca5fc3c4cfdab0d00571b89546f (127.15.239.193:44617): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3fc6370fd6984688a55b88f9e74a85be: Network error: Client connection negotiation failed: client connection to 127.15.239.193:44617: connect: Connection refused (error 111)
I20260810 04:55:01.528707 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 14066
I20260810 04:55:01.547578 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 13492
2026-08-10T04:55:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2584 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T04:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:01Z Disabled control of system clock
I20260810 04:55:01.588243 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39331
--webserver_interface=127.15.239.254
--webserver_port=0
--builtin_ntp_servers=127.15.239.212:38265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:39331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:55:01.684188 14357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:01.684478 14357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:01.684500 14357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:01.685668 14357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:01.685702 14357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:01.685714 14357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:01.685727 14357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:01.685739 14357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:01.687088 14357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:39331
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:01.687350 14357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:01.687698 14357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:01.693523 14366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:01.693586 14362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:01.693550 14364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:01.693871 14357 server_base.cc:1034] running on GCE node
I20260810 04:55:01.694180 14357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:01.694586 14357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:01.695773 14357 hybrid_clock.cc:648] HybridClock initialized: now 1786337701695762 us; error 39 us; skew 500 ppm
I20260810 04:55:01.697321 14357 webserver.cc:460] Webserver started at http://127.15.239.254:38089/ using document root <none> and password file <none>
I20260810 04:55:01.697676 14357 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:01.697752 14357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:01.697913 14357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:01.699172 14357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "03be2239993445debd375525fd993401"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "981289ae358b79ad56502ba09d24df84"
server_key_iv: "b1e6370d643b1b297c62ad6727592c27"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.699616 14357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "03be2239993445debd375525fd993401"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "981289ae358b79ad56502ba09d24df84"
server_key_iv: "b1e6370d643b1b297c62ad6727592c27"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.701203 14357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260810 04:55:01.702024 14376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.702207 14357 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 04:55:01.702328 14357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "03be2239993445debd375525fd993401"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "981289ae358b79ad56502ba09d24df84"
server_key_iv: "b1e6370d643b1b297c62ad6727592c27"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.702421 14357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:01.715812 14357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:01.716256 14357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:01.716437 14357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:01.721546 14357 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:39331
I20260810 04:55:01.721580 14469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:39331 every 8 connection(s)
I20260810 04:55:01.722002 14357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:01.723204 14472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:01.724310 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 14357
I20260810 04:55:01.724449 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:01.724750 16319 external_mini_cluster.cc:1428] Setting key b238a3841fa153877c7a018ab70ef5ae
I20260810 04:55:01.726435 14472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401: Bootstrap starting.
I20260810 04:55:01.727232 14472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:01.727618 14472 log.cc:824] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:01.728591 14472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401: No bootstrap required, opened a new log
I20260810 04:55:01.731164 14472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03be2239993445debd375525fd993401" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39331 } }
I20260810 04:55:01.731379 14472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:01.731421 14472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03be2239993445debd375525fd993401, State: Initialized, Role: FOLLOWER
I20260810 04:55:01.731619 14472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03be2239993445debd375525fd993401" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39331 } }
I20260810 04:55:01.731710 14472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:01.731735 14472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:01.731792 14472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:01.731855 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.725480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55318 (local address 127.15.239.254:39331)
0810 04:55:01.725733 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.725745 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.725783 (+ 38us) server_negotiation.cc:407] Connection header received
0810 04:55:01.726284 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.726292 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.726365 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.726516 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:01.726823 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.728219 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.729410 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.729861 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.729965 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.730918 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:01.730923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:01.730923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:01.731144 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:01.731187 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:01.731199 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:01.731285 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.731415 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.731521 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":114,"threads_started":1}
I20260810 04:55:01.732586 14472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03be2239993445debd375525fd993401" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39331 } }
I20260810 04:55:01.732710 14472 leader_election.cc:302] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03be2239993445debd375525fd993401; no voters:
I20260810 04:55:01.732923 14472 leader_election.cc:288] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:01.732990 14477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:01.733198 14477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [term 1 LEADER]: Becoming Leader. State: Replica: 03be2239993445debd375525fd993401, State: Running, Role: LEADER
I20260810 04:55:01.733249 14472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:01.733304 14477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03be2239993445debd375525fd993401" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39331 } }
I20260810 04:55:01.733739 14479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03be2239993445debd375525fd993401. Latest consensus state: current_term: 1 leader_uuid: "03be2239993445debd375525fd993401" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03be2239993445debd375525fd993401" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39331 } } }
I20260810 04:55:01.733865 14479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:01.733729 14478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03be2239993445debd375525fd993401" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03be2239993445debd375525fd993401" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39331 } } }
I20260810 04:55:01.734018 14478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:01.734207 14492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:01.734833 14492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:01.736771 14492 catalog_manager.cc:1347] Generated new cluster ID: 6faa3729f19548f6a7c97330beffc881
I20260810 04:55:01.736850 14492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:01.751526 14492 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:01.752292 14492 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:01.755578 14492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401: Generated new TSK 0
I20260810 04:55:01.755822 14492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:01.765389 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.193:0
--local_ip_for_outbound_sockets=127.15.239.193
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39331
--builtin_ntp_servers=127.15.239.212:38265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 04:55:01.870633 14508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:01.870922 14508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:01.870945 14508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:01.872354 14508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:01.872401 14508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:01.872430 14508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.193
I20260810 04:55:01.874011 14508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.239.193
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.193
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:01.874341 14508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:01.874752 14508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:01.881899 14518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:01.881922 14516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:01.881899 14515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:01.882192 14508 server_base.cc:1034] running on GCE node
I20260810 04:55:01.882483 14508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:01.882895 14508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:01.884126 14508 hybrid_clock.cc:648] HybridClock initialized: now 1786337701884114 us; error 40 us; skew 500 ppm
I20260810 04:55:01.885855 14508 webserver.cc:460] Webserver started at http://127.15.239.193:34677/ using document root <none> and password file <none>
I20260810 04:55:01.886157 14508 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:01.886236 14508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:01.886418 14508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:01.887787 14508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data/instance:
uuid: "008dc8568b264146a4a2d36b5db793f6"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "e398532c1ca4da310d88bdd02ae97b5f"
server_key_iv: "16c498e6d2a9294755f272375f8bf46e"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.888264 14508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance:
uuid: "008dc8568b264146a4a2d36b5db793f6"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "e398532c1ca4da310d88bdd02ae97b5f"
server_key_iv: "16c498e6d2a9294755f272375f8bf46e"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.890049 14508 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260810 04:55:01.891036 14526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.891356 14508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:01.891489 14508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal
uuid: "008dc8568b264146a4a2d36b5db793f6"
format_stamp: "Formatted at 2026-08-10 04:55:01 on dist-test-slave-kvfs"
server_key: "e398532c1ca4da310d88bdd02ae97b5f"
server_key_iv: "16c498e6d2a9294755f272375f8bf46e"
server_key_version: "encryptionkey@0"
I20260810 04:55:01.891585 14508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:01.901250 14508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:01.901651 14508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:01.901827 14508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:01.902127 14508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:55:01.902549 14508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:55:01.902609 14508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.902658 14508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:55:01.902690 14508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:01.910509 14508 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.193:45635
I20260810 04:55:01.910590 14693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.193:45635 every 8 connection(s)
I20260810 04:55:01.911038 14508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/data/info.pb
I20260810 04:55:01.914002 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 14508
I20260810 04:55:01.914141 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-0/wal/instance
I20260810 04:55:01.914413 16319 external_mini_cluster.cc:1428] Setting key c9b27906368ef01b27a297fa00c35175
I20260810 04:55:01.915586 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.194:0
--local_ip_for_outbound_sockets=127.15.239.194
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39331
--builtin_ntp_servers=127.15.239.212:38265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 04:55:01.918002 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.912085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:44721 (local address 127.15.239.254:39331)
0810 04:55:01.912162 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:01.912165 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:01.912462 (+ 297us) server_negotiation.cc:407] Connection header received
0810 04:55:01.913160 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:01.913161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:01.913176 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:01.913241 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:01.914316 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.914956 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.916263 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.916488 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.916585 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.917645 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:01.917646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:01.917647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:01.917653 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:01.917675 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:01.917682 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:01.917752 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:01.917864 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 04:55:01.917903 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:55:01.918283 14697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:01.912026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39331 (local address 127.15.239.193:44721)
0810 04:55:01.912316 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:01.912358 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:01.913021 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:01.913344 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:01.913348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:01.913358 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:01.914186 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.914194 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.915089 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.915090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.916169 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:01.916172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:01.916601 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:01.916602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:01.916768 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:01.917463 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:55:01.917463 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:01.917501 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:55:01.917530 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:01.917754 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:01.917763 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:01.917767 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:55:01.917868 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 04:55:01.918012 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":111,"threads_started":1}
I20260810 04:55:01.918869 14694 heartbeater.cc:347] Connected to a master server at 127.15.239.254:39331
I20260810 04:55:01.919021 14694 heartbeater.cc:464] Registering TS with master...
I20260810 04:55:01.919248 14694 heartbeater.cc:511] Master 127.15.239.254:39331 requested a full tablet report, sending...
I20260810 04:55:01.919937 14408 ts_manager.cc:194] Registered new tserver with Master: 008dc8568b264146a4a2d36b5db793f6 (127.15.239.193:45635)
I20260810 04:55:01.920709 14408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.193:44721
W20260810 04:55:02.015588 14698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:02.015874 14698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:02.015909 14698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:02.017292 14698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:02.017346 14698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:02.017376 14698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.194
I20260810 04:55:02.018854 14698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.239.194
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.194
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:02.019202 14698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:02.019596 14698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:02.025919 14707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:02.025919 14710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:02.025920 14706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:02.026301 14698 server_base.cc:1034] running on GCE node
I20260810 04:55:02.026553 14698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:02.026793 14698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:02.028002 14698 hybrid_clock.cc:648] HybridClock initialized: now 1786337702027959 us; error 59 us; skew 500 ppm
I20260810 04:55:02.029666 14698 webserver.cc:460] Webserver started at http://127.15.239.194:44613/ using document root <none> and password file <none>
I20260810 04:55:02.029992 14698 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:02.030074 14698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:02.030256 14698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:02.031597 14698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data/instance:
uuid: "c386736b48d24f2dbd6ba3bd7ed7086f"
format_stamp: "Formatted at 2026-08-10 04:55:02 on dist-test-slave-kvfs"
server_key: "808883ad2059274e9f74ed19e6caefdd"
server_key_iv: "47f71389868f2b988247dbaf8a06b670"
server_key_version: "encryptionkey@0"
I20260810 04:55:02.032133 14698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance:
uuid: "c386736b48d24f2dbd6ba3bd7ed7086f"
format_stamp: "Formatted at 2026-08-10 04:55:02 on dist-test-slave-kvfs"
server_key: "808883ad2059274e9f74ed19e6caefdd"
server_key_iv: "47f71389868f2b988247dbaf8a06b670"
server_key_version: "encryptionkey@0"
I20260810 04:55:02.033869 14698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:02.034778 14721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:02.035055 14698 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:02.035212 14698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal
uuid: "c386736b48d24f2dbd6ba3bd7ed7086f"
format_stamp: "Formatted at 2026-08-10 04:55:02 on dist-test-slave-kvfs"
server_key: "808883ad2059274e9f74ed19e6caefdd"
server_key_iv: "47f71389868f2b988247dbaf8a06b670"
server_key_version: "encryptionkey@0"
I20260810 04:55:02.035310 14698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:02.058275 14698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:02.058758 14698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:02.058977 14698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:02.059306 14698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:55:02.059767 14698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:55:02.059828 14698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:02.059906 14698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:55:02.059937 14698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:02.067332 14698 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.194:42913
I20260810 04:55:02.067466 14894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.194:42913 every 8 connection(s)
I20260810 04:55:02.067873 14698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/data/info.pb
I20260810 04:55:02.074292 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.068905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.194:59015 (local address 127.15.239.254:39331)
0810 04:55:02.069003 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.069006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.069277 (+ 271us) server_negotiation.cc:407] Connection header received
0810 04:55:02.069870 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.069872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.069884 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.069960 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:02.070756 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.071323 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.072537 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.072759 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.072823 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.073887 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:02.073889 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:02.073889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:02.073895 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:02.073934 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:02.073939 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:02.074021 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.074135 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.074170 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 04:55:02.074282 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 14698
I20260810 04:55:02.074429 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal/instance
I20260810 04:55:02.074601 14897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.068861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39331 (local address 127.15.239.194:59015)
0810 04:55:02.069124 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.069170 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.069773 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.070028 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.070032 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.070042 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:02.070675 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.070679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.071416 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.071416 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.072430 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.072433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.072892 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.072893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.073034 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.073687 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:55:02.073688 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:02.073726 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:55:02.073788 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:02.074032 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:02.074038 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:02.074041 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.074110 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.074222 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":125,"threads_started":1}
I20260810 04:55:02.074730 16319 external_mini_cluster.cc:1428] Setting key aaa2a9870a730d64b55ec733cce0c5f7
I20260810 04:55:02.075331 14895 heartbeater.cc:347] Connected to a master server at 127.15.239.254:39331
I20260810 04:55:02.075444 14895 heartbeater.cc:464] Registering TS with master...
I20260810 04:55:02.075687 14895 heartbeater.cc:511] Master 127.15.239.254:39331 requested a full tablet report, sending...
I20260810 04:55:02.076181 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.239.195:0
--local_ip_for_outbound_sockets=127.15.239.195
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39331
--builtin_ntp_servers=127.15.239.212:38265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 04:55:02.076367 14407 ts_manager.cc:194] Registered new tserver with Master: c386736b48d24f2dbd6ba3bd7ed7086f (127.15.239.194:42913)
I20260810 04:55:02.076933 14407 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.194:59015
W20260810 04:55:02.173954 14899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:02.174263 14899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:02.174286 14899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:02.175482 14899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:02.175518 14899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:02.175545 14899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.195
I20260810 04:55:02.176930 14899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:38265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.239.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.239.195
--webserver_port=0
--tserver_master_addrs=127.15.239.254:39331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.239.195
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:02.177201 14899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:02.177525 14899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:55:02.183677 14899 server_base.cc:1034] running on GCE node
W20260810 04:55:02.183646 14908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:02.183641 14910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:02.183641 14906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:02.184258 14899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:02.184599 14899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:02.185792 14899 hybrid_clock.cc:648] HybridClock initialized: now 1786337702185774 us; error 30 us; skew 500 ppm
I20260810 04:55:02.187510 14899 webserver.cc:460] Webserver started at http://127.15.239.195:38675/ using document root <none> and password file <none>
I20260810 04:55:02.187832 14899 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:02.187911 14899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:02.188122 14899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:02.189432 14899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data/instance:
uuid: "23d77ae7ce2f4940b827ab9d75cdad16"
format_stamp: "Formatted at 2026-08-10 04:55:02 on dist-test-slave-kvfs"
server_key: "9f16ca4b150ee655123115eadd1faf2a"
server_key_iv: "ea6d3eb8062dc819908569a5b13d03fe"
server_key_version: "encryptionkey@0"
I20260810 04:55:02.189883 14899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance:
uuid: "23d77ae7ce2f4940b827ab9d75cdad16"
format_stamp: "Formatted at 2026-08-10 04:55:02 on dist-test-slave-kvfs"
server_key: "9f16ca4b150ee655123115eadd1faf2a"
server_key_iv: "ea6d3eb8062dc819908569a5b13d03fe"
server_key_version: "encryptionkey@0"
I20260810 04:55:02.191425 14899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:55:02.192363 14919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:02.192582 14899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:02.192706 14899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal
uuid: "23d77ae7ce2f4940b827ab9d75cdad16"
format_stamp: "Formatted at 2026-08-10 04:55:02 on dist-test-slave-kvfs"
server_key: "9f16ca4b150ee655123115eadd1faf2a"
server_key_iv: "ea6d3eb8062dc819908569a5b13d03fe"
server_key_version: "encryptionkey@0"
I20260810 04:55:02.192791 14899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:02.215900 14899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:02.216411 14899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:02.216562 14899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:02.216804 14899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:55:02.217239 14899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:55:02.217278 14899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:02.217332 14899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:55:02.217360 14899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:02.224815 14899 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.195:44701
I20260810 04:55:02.224861 15103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.195:44701 every 8 connection(s)
I20260810 04:55:02.225358 14899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/data/info.pb
I20260810 04:55:02.232585 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.226447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.195:52867 (local address 127.15.239.254:39331)
0810 04:55:02.226524 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.226526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.226877 (+ 351us) server_negotiation.cc:407] Connection header received
0810 04:55:02.227600 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.227602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.227633 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.227709 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:02.228811 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.229429 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.230646 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.230891 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.230978 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.232177 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:02.232178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:02.232178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:02.232191 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:02.232211 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:02.232215 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:02.232276 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.232461 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.232502 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 04:55:02.232831 15109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.226418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:39331 (local address 127.15.239.195:52867)
0810 04:55:02.226695 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.226742 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.227455 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.227823 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.227829 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.227840 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:02.228692 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.228698 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.229552 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.229553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.230542 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.230545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.231003 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.231004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.231171 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.231890 (+ 719us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 04:55:02.231890 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:02.231947 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 04:55:02.231993 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:02.232317 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:02.232325 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:02.232329 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.232441 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.232559 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":123,"threads_started":1}
I20260810 04:55:02.233544 15105 heartbeater.cc:347] Connected to a master server at 127.15.239.254:39331
I20260810 04:55:02.233731 15105 heartbeater.cc:464] Registering TS with master...
I20260810 04:55:02.233975 15105 heartbeater.cc:511] Master 127.15.239.254:39331 requested a full tablet report, sending...
I20260810 04:55:02.234467 14407 ts_manager.cc:194] Registered new tserver with Master: 23d77ae7ce2f4940b827ab9d75cdad16 (127.15.239.195:44701)
I20260810 04:55:02.234488 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 14899
I20260810 04:55:02.234594 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal/instance
I20260810 04:55:02.234853 16319 external_mini_cluster.cc:1428] Setting key b53ce0613f24cc7f381b3fc0f7358500
I20260810 04:55:02.235064 14407 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.239.195:52867
I20260810 04:55:02.235872 16319 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:55:02.240865 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.237587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55326 (local address 127.15.239.254:39331)
0810 04:55:02.237668 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.237670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.237785 (+ 115us) server_negotiation.cc:407] Connection header received
0810 04:55:02.237812 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.237813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.237824 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.237886 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:02.238058 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.238610 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.239486 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.239689 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.239755 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.240642 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:02.240644 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:02.240644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:02.240649 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:02.240665 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:02.240670 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:02.240724 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.240767 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.240793 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 04:55:02.242909 14408 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55326:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:55:02.245065 14408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:55:02.253490 15126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.248072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.15.239.195:44701)
0810 04:55:02.248811 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.248818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.248829 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:55:02.248875 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.248877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.248921 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.249183 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:02.249255 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.250341 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.252087 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.252940 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.253019 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.253136 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.253317 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.253373 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":118,"threads_started":1}
I20260810 04:55:02.253484 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.247852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44701 (local address 127.0.0.1:42398)
0810 04:55:02.248556 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.248566 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.248650 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.249038 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.249039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.249042 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:02.249107 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.249110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.250438 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.250439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.251963 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.251965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.253067 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.253068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.253173 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.253190 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.253282 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.253370 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":109,"thread_start_us":75,"threads_started":1}
I20260810 04:55:02.253690 15124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.247852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42913 (local address 127.0.0.1:50306)
0810 04:55:02.248140 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.248199 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.248286 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.248717 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.248721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.248724 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:02.248823 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.248826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.250723 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.250724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.251962 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.251965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.253423 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.253424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.253494 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.253500 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.253532 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.253585 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
I20260810 04:55:02.254125 15128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.248100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50306 (local address 127.15.239.194:42913)
0810 04:55:02.248408 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.248415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.248429 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:55:02.248484 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.248486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.248506 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.248609 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:02.248984 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.250639 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.252093 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.253312 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.253816 (+ 504us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.253929 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.253956 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.254013 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":139,"threads_started":1}
I20260810 04:55:02.254652 14991 tablet_service.cc:1467] Processing CreateTablet for tablet d744d870611644bfbcad12e269b6d0cb (DEFAULT_TABLE table=test-table [id=a357a8593dc94be69344c880b0cbe550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:55:02.254825 14800 tablet_service.cc:1467] Processing CreateTablet for tablet d744d870611644bfbcad12e269b6d0cb (DEFAULT_TABLE table=test-table [id=a357a8593dc94be69344c880b0cbe550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:55:02.255191 14991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d744d870611644bfbcad12e269b6d0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:02.255285 14800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d744d870611644bfbcad12e269b6d0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:02.255777 15121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.248141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:45635 (local address 127.0.0.1:57406)
0810 04:55:02.248940 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.248953 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.249003 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.250752 (+ 1749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.250754 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.250756 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:02.250820 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.250822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.252445 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.252446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.253659 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.253663 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.255427 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.255428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.255513 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.255518 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.255613 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.255664 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":58,"threads_started":1}
I20260810 04:55:02.255834 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.249512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57406 (local address 127.15.239.193:45635)
0810 04:55:02.250540 (+ 1028us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.250545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.250559 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:55:02.250608 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.250610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.250627 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.250925 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:02.251012 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.252328 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.254183 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.255290 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.255384 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.255488 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.255643 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.255704 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":136,"threads_started":1}
I20260810 04:55:02.258690 15133 tablet_bootstrap.cc:492] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Bootstrap starting.
I20260810 04:55:02.258924 15130 tablet_bootstrap.cc:492] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Bootstrap starting.
I20260810 04:55:02.259640 15133 tablet_bootstrap.cc:654] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:02.259680 15130 tablet_bootstrap.cc:654] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:02.259964 15133 log.cc:824] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:02.260018 15130 log.cc:824] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:02.259994 14592 tablet_service.cc:1467] Processing CreateTablet for tablet d744d870611644bfbcad12e269b6d0cb (DEFAULT_TABLE table=test-table [id=a357a8593dc94be69344c880b0cbe550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 04:55:02.260488 14592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d744d870611644bfbcad12e269b6d0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:02.260941 15133 tablet_bootstrap.cc:492] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: No bootstrap required, opened a new log
I20260810 04:55:02.260950 15130 tablet_bootstrap.cc:492] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: No bootstrap required, opened a new log
I20260810 04:55:02.261031 15133 ts_tablet_manager.cc:1397] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 04:55:02.261031 15130 ts_tablet_manager.cc:1397] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:55:02.263689 15139 tablet_bootstrap.cc:492] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: Bootstrap starting.
I20260810 04:55:02.264235 15130 raft_consensus.cc:348] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.264458 15130 raft_consensus.cc:374] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:02.264477 15139 tablet_bootstrap.cc:654] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:02.264518 15130 raft_consensus.cc:729] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c386736b48d24f2dbd6ba3bd7ed7086f, State: Initialized, Role: FOLLOWER
I20260810 04:55:02.264457 15133 raft_consensus.cc:348] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.264613 15133 raft_consensus.cc:374] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:02.264658 15133 raft_consensus.cc:729] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23d77ae7ce2f4940b827ab9d75cdad16, State: Initialized, Role: FOLLOWER
I20260810 04:55:02.264694 15130 consensus_queue.cc:260] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.264768 15133 consensus_queue.cc:260] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.264829 15139 log.cc:824] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:02.265060 15133 ts_tablet_manager.cc:1428] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260810 04:55:02.265061 15130 ts_tablet_manager.cc:1428] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260810 04:55:02.265089 14895 heartbeater.cc:503] Master 127.15.239.254:39331 was elected leader, sending a full tablet report...
I20260810 04:55:02.265213 15105 heartbeater.cc:503] Master 127.15.239.254:39331 was elected leader, sending a full tablet report...
I20260810 04:55:02.265892 15139 tablet_bootstrap.cc:492] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: No bootstrap required, opened a new log
I20260810 04:55:02.265975 15139 ts_tablet_manager.cc:1397] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:55:02.268622 15139 raft_consensus.cc:348] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.268779 15139 raft_consensus.cc:374] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:02.268805 15139 raft_consensus.cc:729] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 008dc8568b264146a4a2d36b5db793f6, State: Initialized, Role: FOLLOWER
I20260810 04:55:02.268955 15139 consensus_queue.cc:260] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.269239 15139 ts_tablet_manager.cc:1428] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 04:55:02.269343 14694 heartbeater.cc:503] Master 127.15.239.254:39331 was elected leader, sending a full tablet report...
W20260810 04:55:02.318668 14896 tablet.cc:2369] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:55:02.412113 14696 tablet.cc:2369] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:55:02.476200 15108 tablet.cc:2369] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:55:02.494809 15147 raft_consensus.cc:482] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:55:02.494997 15147 raft_consensus.cc:504] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.495628 15147 leader_election.cc:288] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c386736b48d24f2dbd6ba3bd7ed7086f (127.15.239.194:42913), 23d77ae7ce2f4940b827ab9d75cdad16 (127.15.239.195:44701)
I20260810 04:55:02.499115 15126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.496096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:57275 (local address 127.15.239.195:44701)
0810 04:55:02.496165 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.496168 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.496245 (+ 77us) server_negotiation.cc:407] Connection header received
0810 04:55:02.496338 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.496339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.496350 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.496405 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:02.496627 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.497172 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.498305 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.498707 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.498797 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.498809 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.498978 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.499019 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 04:55:02.499150 15128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.495976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.239.193:46839 (local address 127.15.239.194:42913)
0810 04:55:02.496069 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.496072 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.496217 (+ 145us) server_negotiation.cc:407] Connection header received
0810 04:55:02.496327 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.496328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.496343 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.496429 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 04:55:02.496645 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.497179 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.498339 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.498740 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.498846 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.498856 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.499030 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.499072 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 04:55:02.499163 15151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.495852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.194:42913 (local address 127.15.239.193:46839)
0810 04:55:02.496139 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.496152 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.496239 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.496432 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.496433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.496435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:02.496546 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.496549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.497283 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.497284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.498213 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.498216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.498852 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.498854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.498943 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.498947 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.499012 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.499053 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":35,"spinlock_wait_cycles":15744,"thread_start_us":151,"threads_started":1}
I20260810 04:55:02.499166 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.495847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.195:44701 (local address 127.15.239.193:57275)
0810 04:55:02.496137 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.496150 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:02.496262 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:02.496427 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:02.496428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:02.496431 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 04:55:02.496547 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.496549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.497302 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.497303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.498211 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:02.498213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.498797 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.498798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:02.498880 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.498884 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 04:55:02.498969 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 04:55:02.499019 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":41,"thread_start_us":197,"threads_started":1}
I20260810 04:55:02.499802 14828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d744d870611644bfbcad12e269b6d0cb" candidate_uuid: "008dc8568b264146a4a2d36b5db793f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" is_pre_election: true
I20260810 04:55:02.500006 14828 raft_consensus.cc:2454] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 008dc8568b264146a4a2d36b5db793f6 in term 0.
I20260810 04:55:02.500254 15024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d744d870611644bfbcad12e269b6d0cb" candidate_uuid: "008dc8568b264146a4a2d36b5db793f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" is_pre_election: true
I20260810 04:55:02.500336 14528 leader_election.cc:302] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008dc8568b264146a4a2d36b5db793f6, c386736b48d24f2dbd6ba3bd7ed7086f; no voters:
I20260810 04:55:02.500409 15024 raft_consensus.cc:2454] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 008dc8568b264146a4a2d36b5db793f6 in term 0.
I20260810 04:55:02.500576 15147 raft_consensus.cc:2781] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:55:02.500641 15147 raft_consensus.cc:482] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:55:02.500669 15147 raft_consensus.cc:3037] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:02.501554 15147 raft_consensus.cc:504] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.501716 15147 leader_election.cc:288] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [CANDIDATE]: Term 1 election: Requested vote from peers c386736b48d24f2dbd6ba3bd7ed7086f (127.15.239.194:42913), 23d77ae7ce2f4940b827ab9d75cdad16 (127.15.239.195:44701)
I20260810 04:55:02.501916 14828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d744d870611644bfbcad12e269b6d0cb" candidate_uuid: "008dc8568b264146a4a2d36b5db793f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f"
I20260810 04:55:02.502005 15024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d744d870611644bfbcad12e269b6d0cb" candidate_uuid: "008dc8568b264146a4a2d36b5db793f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23d77ae7ce2f4940b827ab9d75cdad16"
I20260810 04:55:02.502027 14828 raft_consensus.cc:3037] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:02.502094 15024 raft_consensus.cc:3037] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:02.503155 15024 raft_consensus.cc:2454] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 008dc8568b264146a4a2d36b5db793f6 in term 1.
I20260810 04:55:02.503155 14828 raft_consensus.cc:2454] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 008dc8568b264146a4a2d36b5db793f6 in term 1.
I20260810 04:55:02.503325 14528 leader_election.cc:302] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008dc8568b264146a4a2d36b5db793f6, c386736b48d24f2dbd6ba3bd7ed7086f; no voters:
I20260810 04:55:02.503418 15147 raft_consensus.cc:2781] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:02.503602 15147 raft_consensus.cc:686] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [term 1 LEADER]: Becoming Leader. State: Replica: 008dc8568b264146a4a2d36b5db793f6, State: Running, Role: LEADER
I20260810 04:55:02.503727 15147 consensus_queue.cc:237] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } }
I20260810 04:55:02.504941 14408 catalog_manager.cc:5495] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 008dc8568b264146a4a2d36b5db793f6 (127.15.239.193). New cstate: current_term: 1 leader_uuid: "008dc8568b264146a4a2d36b5db793f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "008dc8568b264146a4a2d36b5db793f6" member_type: VOTER last_known_addr { host: "127.15.239.193" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260810 04:55:02.542157 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.539287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57410 (local address 127.15.239.193:45635)
0810 04:55:02.539368 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:02.539371 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:02.539383 (+ 12us) server_negotiation.cc:407] Connection header received
0810 04:55:02.539449 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:02.539450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:02.539493 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:02.539604 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:02.539794 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.540410 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.541315 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:02.541555 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:02.541624 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:02.541788 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:02.541954 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:02.542030 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:02.542047 (+ 17us) server_negotiation.cc:299] Negotiation successful
0810 04:55:02.542072 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 04:55:02.544767 15024 raft_consensus.cc:1261] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 1 FOLLOWER]: Refusing update from remote peer 008dc8568b264146a4a2d36b5db793f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:02.544767 14828 raft_consensus.cc:1261] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 1 FOLLOWER]: Refusing update from remote peer 008dc8568b264146a4a2d36b5db793f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:02.545287 15154 consensus_queue.cc:1035] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23d77ae7ce2f4940b827ab9d75cdad16" member_type: VOTER last_known_addr { host: "127.15.239.195" port: 44701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:02.545463 15147 consensus_queue.cc:1035] T d744d870611644bfbcad12e269b6d0cb P 008dc8568b264146a4a2d36b5db793f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c386736b48d24f2dbd6ba3bd7ed7086f" member_type: VOTER last_known_addr { host: "127.15.239.194" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:02.548887 15161 mvcc.cc:205] Tried to move back new op lower bound from 7316839229619286016 to 7316839229456035840. Current Snapshot: MvccSnapshot[applied={T|T < 7316839229619286016}]
I20260810 04:55:02.549801 15160 mvcc.cc:205] Tried to move back new op lower bound from 7316839229619286016 to 7316839229456035840. Current Snapshot: MvccSnapshot[applied={T|T < 7316839229619286016}]
I20260810 04:55:02.551616 14408 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:55:02.551733 14408 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 04:55:02.552848 14408 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03be2239993445debd375525fd993401: Sending DeleteTablet for 3 replicas of tablet d744d870611644bfbcad12e269b6d0cb
I20260810 04:55:02.553364 14800 tablet_service.cc:1514] Processing DeleteTablet for tablet d744d870611644bfbcad12e269b6d0cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:55:02 UTC) from {username='slave'} at 127.0.0.1:50306
I20260810 04:55:02.553690 15172 tablet_replica.cc:330] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: stopping tablet replica
I20260810 04:55:02.553671 14991 tablet_service.cc:1514] Processing DeleteTablet for tablet d744d870611644bfbcad12e269b6d0cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:55:02 UTC) from {username='slave'} at 127.0.0.1:42398
I20260810 04:55:02.553841 15172 raft_consensus.cc:2229] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:55:02.553978 15172 raft_consensus.cc:2258] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:55:02.553943 14592 tablet_service.cc:1514] Processing DeleteTablet for tablet d744d870611644bfbcad12e269b6d0cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 04:55:02 UTC) from {username='slave'} at 127.0.0.1:57406
I20260810 04:55:02.554327 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 14508
I20260810 04:55:02.554558 15172 ts_tablet_manager.cc:1905] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:55:02.556957 15172 ts_tablet_manager.cc:1918] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:55:02.557044 15172 log.cc:1196] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-1/wal/wals/d744d870611644bfbcad12e269b6d0cb
I20260810 04:55:02.557300 15172 ts_tablet_manager.cc:1939] T d744d870611644bfbcad12e269b6d0cb P c386736b48d24f2dbd6ba3bd7ed7086f: Deleting consensus metadata
I20260810 04:55:02.563750 14381 catalog_manager.cc:4841] TS c386736b48d24f2dbd6ba3bd7ed7086f (127.15.239.194:42913): tablet d744d870611644bfbcad12e269b6d0cb (table test-table [id=a357a8593dc94be69344c880b0cbe550]) successfully deleted
I20260810 04:55:02.565474 15176 tablet_replica.cc:330] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: stopping tablet replica
I20260810 04:55:02.565680 15176 raft_consensus.cc:2229] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 04:55:02.565889 15176 raft_consensus.cc:2258] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 04:55:02.566548 15176 ts_tablet_manager.cc:1905] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 04:55:02.569013 15176 ts_tablet_manager.cc:1918] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 04:55:02.569115 15176 log.cc:1196] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Deleting WAL directory at /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786337435403234-16319-0/minicluster-data/ts-2/wal/wals/d744d870611644bfbcad12e269b6d0cb
I20260810 04:55:02.569406 15176 ts_tablet_manager.cc:1939] T d744d870611644bfbcad12e269b6d0cb P 23d77ae7ce2f4940b827ab9d75cdad16: Deleting consensus metadata
I20260810 04:55:02.570031 14380 catalog_manager.cc:4841] TS 23d77ae7ce2f4940b827ab9d75cdad16 (127.15.239.195:44701): tablet d744d870611644bfbcad12e269b6d0cb (table test-table [id=a357a8593dc94be69344c880b0cbe550]) successfully deleted
W20260810 04:55:02.573024 14380 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.239.193:45635 (error 108)
I20260810 04:55:02.573319 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 14698
I20260810 04:55:02.573663 15121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:02.573501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.193:45635 (local address 127.0.0.1:57420)
0810 04:55:02.573563 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:02.573611 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.193:45635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:55:02.573794 14380 catalog_manager.cc:4584] TS 008dc8568b264146a4a2d36b5db793f6 (127.15.239.193:45635): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d744d870611644bfbcad12e269b6d0cb: Network error: Client connection negotiation failed: client connection to 127.15.239.193:45635: connect: Connection refused (error 111)
I20260810 04:55:02.590122 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 14899
I20260810 04:55:02.599875 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 14357
2026-08-10T04:55:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1050 ms)
[----------] 6 tests from EncryptionPolicyTest (10431 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:02 dist-test-slave-kvfs krb5kdc[15182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:02 dist-test-slave-kvfs krb5kdc[15182](info): set up 2 sockets
Aug 10 04:55:02 dist-test-slave-kvfs krb5kdc[15182](info): commencing operation
krb5kdc: starting...
W20260810 04:55:03.904239 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:04 dist-test-slave-kvfs krb5kdc[15182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:04.055500 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:04.154973 15206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:04.155231 15206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:04.155256 15206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:04.156451 15206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:04.156490 15206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:04.156505 15206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:04.156517 15206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:04.156530 15206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:04.158041 15206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44121
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:04.158275 15206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:04.158485 15206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:04.164395 15216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:04.164506 15214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:04.164662 15206 server_base.cc:1034] running on GCE node
W20260810 04:55:04.164395 15213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:04.165109 15206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:04.165508 15206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:04.166692 15206 hybrid_clock.cc:648] HybridClock initialized: now 1786337704166661 us; error 55 us; skew 500 ppm
Aug 10 04:55:04 dist-test-slave-kvfs krb5kdc[15182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:04.169831 15206 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:04.170342 15206 webserver.cc:460] Webserver started at http://127.0.0.1:33129/ using document root <none> and password file <none>
I20260810 04:55:04.170601 15206 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:04.170673 15206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:04.170862 15206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:04.172205 15206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "84d471cd64614fc7af814573798fca4e"
format_stamp: "Formatted at 2026-08-10 04:55:04 on dist-test-slave-kvfs"
server_key: "e1becd07f30e6a0424a3f9ed25a2ce69"
server_key_iv: "3775861bb2d7aa577777f7d69c3e3ad7"
server_key_version: "encryptionkey@0"
I20260810 04:55:04.172623 15206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "84d471cd64614fc7af814573798fca4e"
format_stamp: "Formatted at 2026-08-10 04:55:04 on dist-test-slave-kvfs"
server_key: "e1becd07f30e6a0424a3f9ed25a2ce69"
server_key_iv: "3775861bb2d7aa577777f7d69c3e3ad7"
server_key_version: "encryptionkey@0"
I20260810 04:55:04.174216 15206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 04:55:04.175137 15224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:04.175366 15206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:04.175490 15206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "84d471cd64614fc7af814573798fca4e"
format_stamp: "Formatted at 2026-08-10 04:55:04 on dist-test-slave-kvfs"
server_key: "e1becd07f30e6a0424a3f9ed25a2ce69"
server_key_iv: "3775861bb2d7aa577777f7d69c3e3ad7"
server_key_version: "encryptionkey@0"
I20260810 04:55:04.175573 15206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:04.195353 15206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:04.198076 15206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:04.198292 15206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:04.203676 15206 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44121
I20260810 04:55:04.203714 15300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44121 every 8 connection(s)
I20260810 04:55:04.204197 15206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:04.205363 15304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:04.208361 15304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e: Bootstrap starting.
I20260810 04:55:04.209086 15304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:04.209368 15304 log.cc:824] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:04.210253 15304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e: No bootstrap required, opened a new log
I20260810 04:55:04.212105 15304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84d471cd64614fc7af814573798fca4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44121 } }
I20260810 04:55:04.212281 15304 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:04.212306 15304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d471cd64614fc7af814573798fca4e, State: Initialized, Role: FOLLOWER
I20260810 04:55:04.212435 15304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84d471cd64614fc7af814573798fca4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44121 } }
I20260810 04:55:04.212522 15304 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:04.212563 15304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:04.212641 15304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:04.213173 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 15206
I20260810 04:55:04.213268 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:04.213315 15304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84d471cd64614fc7af814573798fca4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44121 } }
I20260810 04:55:04.213516 16319 external_mini_cluster.cc:1428] Setting key cb94e72dd924402e0e89d3c70f88e443
I20260810 04:55:04.213582 15304 leader_election.cc:302] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84d471cd64614fc7af814573798fca4e; no voters:
I20260810 04:55:04.213799 15304 leader_election.cc:288] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:04.213829 15307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:04.214023 15307 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [term 1 LEADER]: Becoming Leader. State: Replica: 84d471cd64614fc7af814573798fca4e, State: Running, Role: LEADER
I20260810 04:55:04.214144 15304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:04.214131 15307 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84d471cd64614fc7af814573798fca4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44121 } }
I20260810 04:55:04.214496 15307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84d471cd64614fc7af814573798fca4e. Latest consensus state: current_term: 1 leader_uuid: "84d471cd64614fc7af814573798fca4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84d471cd64614fc7af814573798fca4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44121 } } }
I20260810 04:55:04.214572 15307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:04.214814 15309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84d471cd64614fc7af814573798fca4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84d471cd64614fc7af814573798fca4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44121 } } }
I20260810 04:55:04.214965 15309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:04.215849 15320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:04.216709 15320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:04.218490 15320 catalog_manager.cc:1347] Generated new cluster ID: 71a964d307ac4614bbc5943c3e7d05e7
I20260810 04:55:04.218551 15320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:55:04 dist-test-slave-kvfs krb5kdc[15182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:55:04.228353 15317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:04.214358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37641 (local address 127.0.0.1:44121)
0810 04:55:04.214849 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:04.214861 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:04.214898 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:55:04.215044 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:04.215053 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:04.215123 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:04.215282 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:04.216439 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:04.217639 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:04.218760 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:04.219455 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:04.219566 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:04.222871 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:04.222877 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:04.222877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:04.222894 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:04.226020 (+ 3126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:04.226540 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:04.226545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:04.226545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:04.226698 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:04.226960 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:04.226961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:04.226962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:04.227341 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:04.227604 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:04.227918 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 04:55:04.228075 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":96,"threads_started":1}
I20260810 04:55:04.228503 15320 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:04.229367 15320 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:04.230141 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:04.232895 15320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84d471cd64614fc7af814573798fca4e: Generated new TSK 0
I20260810 04:55:04.233114 15320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:04.239557 15317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:04.232390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49539 (local address 127.0.0.1:44121)
0810 04:55:04.232438 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:04.232440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:04.232578 (+ 138us) server_negotiation.cc:407] Connection header received
0810 04:55:04.232656 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:04.232656 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:04.232667 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:04.232714 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:04.233581 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:04.234135 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:04.234923 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:04.235166 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:04.235248 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:04.236660 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:04.236662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:04.236662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:04.236670 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:04.238303 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:04.238701 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:04.238702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:04.238702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:04.238767 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:04.239011 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:04.239012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:04.239013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:04.239129 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:04.239255 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:04.239382 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:55:04.239451 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:55:04.241941 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 15206
W20260810 04:55:04.266906 15180 connection.cc:535] client connection to 127.0.0.1:44121 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44121): Connection reset by peer (error 104)
2026-08-10T04:55:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1654 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:04 dist-test-slave-kvfs krb5kdc[15353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:04 dist-test-slave-kvfs krb5kdc[15353](info): set up 2 sockets
Aug 10 04:55:04 dist-test-slave-kvfs krb5kdc[15353](info): commencing operation
krb5kdc: starting...
W20260810 04:55:05.551455 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:05 dist-test-slave-kvfs krb5kdc[15353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:05.700654 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:05.801853 15374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:05.802150 15374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:05.802191 15374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:05.803421 15374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:05.803493 15374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:05.803516 15374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:05.803548 15374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:05.803576 15374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:05.805276 15374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:05.805785 15374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:05.806113 15374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:05.811956 15391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:05.811956 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:05.811990 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:05.812153 15374 server_base.cc:1034] running on GCE node
I20260810 04:55:05.812547 15374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:05.812927 15374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:05.814107 15374 hybrid_clock.cc:648] HybridClock initialized: now 1786337705814092 us; error 35 us; skew 500 ppm
Aug 10 04:55:05 dist-test-slave-kvfs krb5kdc[15353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337705, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:05.817250 15374 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:05.817821 15374 webserver.cc:460] Webserver started at http://127.0.0.1:39999/ using document root <none> and password file <none>
I20260810 04:55:05.818116 15374 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:05.818193 15374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:05.818360 15374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:05.819622 15374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "735203221ec54726971b63adebd51f61"
format_stamp: "Formatted at 2026-08-10 04:55:05 on dist-test-slave-kvfs"
server_key: "775f2fd54bcfab28b2b918c100a6be46"
server_key_iv: "22fbd91068fcb5123750706d4a7bf939"
server_key_version: "encryptionkey@0"
I20260810 04:55:05.820103 15374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "735203221ec54726971b63adebd51f61"
format_stamp: "Formatted at 2026-08-10 04:55:05 on dist-test-slave-kvfs"
server_key: "775f2fd54bcfab28b2b918c100a6be46"
server_key_iv: "22fbd91068fcb5123750706d4a7bf939"
server_key_version: "encryptionkey@0"
I20260810 04:55:05.821635 15374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:05.822530 15406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:05.822758 15374 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:05.822865 15374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "735203221ec54726971b63adebd51f61"
format_stamp: "Formatted at 2026-08-10 04:55:05 on dist-test-slave-kvfs"
server_key: "775f2fd54bcfab28b2b918c100a6be46"
server_key_iv: "22fbd91068fcb5123750706d4a7bf939"
server_key_version: "encryptionkey@0"
I20260810 04:55:05.822959 15374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:05.833732 15374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:05.836453 15374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:05.836639 15374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:05.842078 15374 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40145
I20260810 04:55:05.842152 15484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40145 every 8 connection(s)
I20260810 04:55:05.842609 15374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:05.843739 15485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:05.846786 15485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61: Bootstrap starting.
I20260810 04:55:05.847564 15485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:05.847921 15485 log.cc:824] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:05.848536 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 15374
I20260810 04:55:05.848651 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:05.848883 16319 external_mini_cluster.cc:1428] Setting key 5d7505ff61e58102989332eb2a8c946c
I20260810 04:55:05.848938 15485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61: No bootstrap required, opened a new log
I20260810 04:55:05.851971 15485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735203221ec54726971b63adebd51f61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260810 04:55:05.852241 15485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:05.852290 15485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735203221ec54726971b63adebd51f61, State: Initialized, Role: FOLLOWER
I20260810 04:55:05.852440 15485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735203221ec54726971b63adebd51f61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260810 04:55:05.852538 15485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:05.852571 15485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:05.852615 15485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:05.853492 15485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735203221ec54726971b63adebd51f61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260810 04:55:05.853628 15485 leader_election.cc:302] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 735203221ec54726971b63adebd51f61; no voters:
I20260810 04:55:05.853870 15485 leader_election.cc:288] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:05.853895 15493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:05.854050 15493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [term 1 LEADER]: Becoming Leader. State: Replica: 735203221ec54726971b63adebd51f61, State: Running, Role: LEADER
I20260810 04:55:05.854213 15485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:05.854218 15493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735203221ec54726971b63adebd51f61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } }
I20260810 04:55:05.854955 15496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "735203221ec54726971b63adebd51f61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735203221ec54726971b63adebd51f61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } } }
I20260810 04:55:05.855057 15496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:05.855758 15497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 735203221ec54726971b63adebd51f61. Latest consensus state: current_term: 1 leader_uuid: "735203221ec54726971b63adebd51f61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735203221ec54726971b63adebd51f61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40145 } } }
I20260810 04:55:05.855914 15497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:05.856149 15492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:05.849550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48937 (local address 127.0.0.1:40145)
0810 04:55:05.849756 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:05.849770 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:05.849805 (+ 35us) server_negotiation.cc:407] Connection header received
0810 04:55:05.850534 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:05.850544 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:05.850608 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:05.850747 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:05.851064 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:05.852138 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:05.853285 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:05.853879 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:05.854424 (+ 545us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:05.855163 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:05.855169 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:05.855170 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:05.855446 (+ 276us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:05.855500 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:05.855521 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:05.855625 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:05.855798 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 04:55:05.855836 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
W20260810 04:55:05.856581 15527 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:05.856667 15527 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:05.856752 15516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:05.856990 15516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:05.857478 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:05.859892 15516 catalog_manager.cc:1347] Generated new cluster ID: 8cc0fc4ee6f84b20a33792f5d539a0b9
I20260810 04:55:05.859953 15516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:05.863731 15492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:05.859529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41765 (local address 127.0.0.1:40145)
0810 04:55:05.859575 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:05.859577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:05.860153 (+ 576us) server_negotiation.cc:407] Connection header received
0810 04:55:05.860183 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:05.860184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:05.860196 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:05.860267 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:05.860431 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:05.861185 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:05.862214 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:05.862559 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:05.862637 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:05.863460 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:05.863461 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:05.863462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:05.863467 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:05.863487 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:05.863492 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:05.863560 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:05.863636 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 04:55:05.863647 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:55:05.891523 15516 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:05.892236 15516 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:05.905129 15516 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 735203221ec54726971b63adebd51f61: Generated new TSK 0
I20260810 04:55:05.905400 15516 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:05.909967 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 15374
W20260810 04:55:05.927529 15349 connection.cc:535] client connection to 127.0.0.1:40145 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40145): Connection reset by peer (error 104)
2026-08-10T04:55:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1660 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:05 dist-test-slave-kvfs krb5kdc[15537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:05 dist-test-slave-kvfs krb5kdc[15537](info): set up 2 sockets
Aug 10 04:55:05 dist-test-slave-kvfs krb5kdc[15537](info): commencing operation
krb5kdc: starting...
W20260810 04:55:07.193135 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:07 dist-test-slave-kvfs krb5kdc[15537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:07.367589 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:07.468194 15559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:07.468478 15559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:07.468503 15559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:07.469708 15559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:07.469748 15559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:07.469763 15559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:07.469784 15559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:07.469796 15559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:07.471364 15559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:07.471616 15559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:07.471846 15559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:07.477672 15568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:07.477653 15570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:07.477654 15575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:07.477767 15559 server_base.cc:1034] running on GCE node
I20260810 04:55:07.478304 15559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:07.478699 15559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:07.479876 15559 hybrid_clock.cc:648] HybridClock initialized: now 1786337707479850 us; error 44 us; skew 500 ppm
Aug 10 04:55:07 dist-test-slave-kvfs krb5kdc[15537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337707, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:07.482944 15559 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:07.483534 15559 webserver.cc:460] Webserver started at http://127.0.0.1:35073/ using document root <none> and password file <none>
I20260810 04:55:07.483824 15559 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:07.483901 15559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:07.484126 15559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:07.485446 15559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "ace961f8bb4b42eda1db322181f776de"
format_stamp: "Formatted at 2026-08-10 04:55:07 on dist-test-slave-kvfs"
server_key: "af3498eeff54d1882cb2ac2eb72fc21e"
server_key_iv: "7d3b79e69b3934ab847d9e7c24254b48"
server_key_version: "encryptionkey@0"
I20260810 04:55:07.485877 15559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "ace961f8bb4b42eda1db322181f776de"
format_stamp: "Formatted at 2026-08-10 04:55:07 on dist-test-slave-kvfs"
server_key: "af3498eeff54d1882cb2ac2eb72fc21e"
server_key_iv: "7d3b79e69b3934ab847d9e7c24254b48"
server_key_version: "encryptionkey@0"
I20260810 04:55:07.487377 15559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:55:07.488238 15591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:07.488453 15559 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:07.488579 15559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "ace961f8bb4b42eda1db322181f776de"
format_stamp: "Formatted at 2026-08-10 04:55:07 on dist-test-slave-kvfs"
server_key: "af3498eeff54d1882cb2ac2eb72fc21e"
server_key_iv: "7d3b79e69b3934ab847d9e7c24254b48"
server_key_version: "encryptionkey@0"
I20260810 04:55:07.488658 15559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:07.492452 15559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:07.494603 15559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:07.494755 15559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:07.499742 15559 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37775
I20260810 04:55:07.499774 15670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37775 every 8 connection(s)
I20260810 04:55:07.500244 15559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:07.501482 15672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:07.504393 15672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de: Bootstrap starting.
I20260810 04:55:07.504982 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 15559
I20260810 04:55:07.505152 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:07.505172 15672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:07.505424 16319 external_mini_cluster.cc:1428] Setting key 851eb2c4d57efba2069886049d05e834
I20260810 04:55:07.505545 15672 log.cc:824] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:07.506565 15672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de: No bootstrap required, opened a new log
I20260810 04:55:07.508566 15680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:07.506142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49437 (local address 127.0.0.1:37775)
0810 04:55:07.506380 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:07.506390 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:07.506420 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:55:07.506974 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:07.506984 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:07.507013 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:07.507154 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:07.507979 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:07.507983 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:07.507983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:07.507987 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:07.508094 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:07.508108 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:07.508192 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:07.508269 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 04:55:07.508329 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":124,"threads_started":1}
I20260810 04:55:07.509487 15672 raft_consensus.cc:348] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace961f8bb4b42eda1db322181f776de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37775 } }
I20260810 04:55:07.509660 15672 raft_consensus.cc:374] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:07.509686 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:07.509711 15672 raft_consensus.cc:729] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ace961f8bb4b42eda1db322181f776de, State: Initialized, Role: FOLLOWER
I20260810 04:55:07.509855 15672 consensus_queue.cc:260] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace961f8bb4b42eda1db322181f776de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37775 } }
I20260810 04:55:07.509961 15672 raft_consensus.cc:388] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:07.510008 15672 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:07.510061 15672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:07.510675 15672 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace961f8bb4b42eda1db322181f776de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37775 } }
I20260810 04:55:07.510810 15672 leader_election.cc:302] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ace961f8bb4b42eda1db322181f776de; no voters:
I20260810 04:55:07.511052 15672 leader_election.cc:288] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:07.511093 15685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:07.511219 15685 raft_consensus.cc:686] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [term 1 LEADER]: Becoming Leader. State: Replica: ace961f8bb4b42eda1db322181f776de, State: Running, Role: LEADER
I20260810 04:55:07.511312 15685 consensus_queue.cc:237] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace961f8bb4b42eda1db322181f776de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37775 } }
I20260810 04:55:07.511389 15672 sys_catalog.cc:564] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:07.511687 15685 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace961f8bb4b42eda1db322181f776de. Latest consensus state: current_term: 1 leader_uuid: "ace961f8bb4b42eda1db322181f776de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace961f8bb4b42eda1db322181f776de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37775 } } }
I20260810 04:55:07.511777 15685 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:07.511703 15687 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ace961f8bb4b42eda1db322181f776de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace961f8bb4b42eda1db322181f776de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37775 } } }
I20260810 04:55:07.511940 15687 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:07.512080 15692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:07.512766 15692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:07.512877 15680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:07.511406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44659 (local address 127.0.0.1:37775)
0810 04:55:07.511441 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:07.511444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:07.511718 (+ 274us) server_negotiation.cc:407] Connection header received
0810 04:55:07.511820 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:07.511821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:07.511826 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:07.511855 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:07.512629 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:07.512630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:07.512630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:07.512635 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:07.512651 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:07.512656 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:07.512687 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:07.512797 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 04:55:07.512810 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:55:07.514859 15692 catalog_manager.cc:1347] Generated new cluster ID: 8662fd1eaf9d43a1b3dc2906d75dfe06
I20260810 04:55:07.514932 15692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:07.523792 15692 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:07.524102 15692 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:07.527834 15692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ace961f8bb4b42eda1db322181f776de: Generated new TSK 0
I20260810 04:55:07.528110 15692 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:07.533718 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 15559
2026-08-10T04:55:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1621 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:07 dist-test-slave-kvfs krb5kdc[15722](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:07 dist-test-slave-kvfs krb5kdc[15722](info): set up 2 sockets
Aug 10 04:55:07 dist-test-slave-kvfs krb5kdc[15722](info): commencing operation
krb5kdc: starting...
W20260810 04:55:08.819826 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:08 dist-test-slave-kvfs krb5kdc[15722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:08.963312 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:09.060817 15738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:09.061192 15738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:09.061239 15738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:09.062486 15738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:09.062567 15738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:09.062592 15738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:09.062613 15738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:09.062642 15738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:09.064283 15738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:09.064627 15738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:09.064913 15738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:09.070710 15744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:09.070814 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:09.070848 15750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:09.071029 15738 server_base.cc:1034] running on GCE node
I20260810 04:55:09.071362 15738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:09.071743 15738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:09.072891 15738 hybrid_clock.cc:648] HybridClock initialized: now 1786337709072861 us; error 70 us; skew 500 ppm
Aug 10 04:55:09 dist-test-slave-kvfs krb5kdc[15722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337709, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:09.081938 15738 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:09.082571 15738 webserver.cc:460] Webserver started at http://127.0.0.1:46533/ using document root <none> and password file <none>
I20260810 04:55:09.082849 15738 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:09.082923 15738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:09.083099 15738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:09.084483 15738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "0ade4e52646246e9bcde0bae3f94f329"
format_stamp: "Formatted at 2026-08-10 04:55:09 on dist-test-slave-kvfs"
server_key: "e6e4522f56d6a6ce36b35dbb38560adf"
server_key_iv: "cfde3030df3eaf4665fddd107bfe9162"
server_key_version: "encryptionkey@0"
I20260810 04:55:09.084901 15738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "0ade4e52646246e9bcde0bae3f94f329"
format_stamp: "Formatted at 2026-08-10 04:55:09 on dist-test-slave-kvfs"
server_key: "e6e4522f56d6a6ce36b35dbb38560adf"
server_key_iv: "cfde3030df3eaf4665fddd107bfe9162"
server_key_version: "encryptionkey@0"
I20260810 04:55:09.086664 15738 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 04:55:09.087621 15763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:09.087877 15738 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:09.088006 15738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "0ade4e52646246e9bcde0bae3f94f329"
format_stamp: "Formatted at 2026-08-10 04:55:09 on dist-test-slave-kvfs"
server_key: "e6e4522f56d6a6ce36b35dbb38560adf"
server_key_iv: "cfde3030df3eaf4665fddd107bfe9162"
server_key_version: "encryptionkey@0"
I20260810 04:55:09.088132 15738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:09.103636 15738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:09.106240 15738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:09.106458 15738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:09.111537 15738 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35085
I20260810 04:55:09.111615 15843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35085 every 8 connection(s)
I20260810 04:55:09.112056 15738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:09.113139 15844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:09.116091 15844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329: Bootstrap starting.
I20260810 04:55:09.116845 15844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:09.117198 15844 log.cc:824] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:09.118038 15844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329: No bootstrap required, opened a new log
I20260810 04:55:09.119886 15844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ade4e52646246e9bcde0bae3f94f329" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35085 } }
I20260810 04:55:09.120078 15844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:09.120105 15844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ade4e52646246e9bcde0bae3f94f329, State: Initialized, Role: FOLLOWER
I20260810 04:55:09.120329 15844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ade4e52646246e9bcde0bae3f94f329" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35085 } }
I20260810 04:55:09.120426 15844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:09.120453 15844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:09.120515 15844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:09.121078 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 15738
I20260810 04:55:09.121155 15844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ade4e52646246e9bcde0bae3f94f329" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35085 } }
I20260810 04:55:09.121227 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:09.121294 15844 leader_election.cc:302] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ade4e52646246e9bcde0bae3f94f329; no voters:
I20260810 04:55:09.121479 16319 external_mini_cluster.cc:1428] Setting key ccce78057cfc8ce41c997791127c20f5
I20260810 04:55:09.121510 15844 leader_election.cc:288] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:09.121541 15849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:09.121758 15849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [term 1 LEADER]: Becoming Leader. State: Replica: 0ade4e52646246e9bcde0bae3f94f329, State: Running, Role: LEADER
I20260810 04:55:09.121831 15844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:09.121882 15849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ade4e52646246e9bcde0bae3f94f329" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35085 } }
I20260810 04:55:09.122309 15850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ade4e52646246e9bcde0bae3f94f329" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ade4e52646246e9bcde0bae3f94f329" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35085 } } }
I20260810 04:55:09.122409 15850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:09.122650 15851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ade4e52646246e9bcde0bae3f94f329. Latest consensus state: current_term: 1 leader_uuid: "0ade4e52646246e9bcde0bae3f94f329" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ade4e52646246e9bcde0bae3f94f329" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35085 } } }
I20260810 04:55:09.122704 15860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:09.122810 15851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:09.123659 15860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:09.128477 15860 catalog_manager.cc:1347] Generated new cluster ID: ec77bf4817534c8ea0716e2f4d1bfb02
I20260810 04:55:09.128540 15860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:55:09 dist-test-slave-kvfs krb5kdc[15722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:55:09.134577 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:09.122500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45939 (local address 127.0.0.1:35085)
0810 04:55:09.122704 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:09.122715 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:09.122756 (+ 41us) server_negotiation.cc:407] Connection header received
0810 04:55:09.122904 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:09.122913 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:09.122976 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:09.124274 (+ 1298us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:09.124402 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:09.125670 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:09.126856 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:09.127315 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:09.127409 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:09.130363 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:09.130372 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:09.130372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:09.130386 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:09.132807 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:09.133219 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:09.133223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:09.133223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:09.133358 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:09.133593 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:09.133593 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:09.133594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:09.133876 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:09.134101 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:09.134178 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 04:55:09.134351 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260810 04:55:09.135618 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:09.141690 15860 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:09.142699 15860 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:09.143841 15864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:09.137364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48929 (local address 127.0.0.1:35085)
0810 04:55:09.137403 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:09.137405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:09.137535 (+ 130us) server_negotiation.cc:407] Connection header received
0810 04:55:09.137610 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:09.137611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:09.137622 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:09.137678 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:09.138222 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:09.138740 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:09.139474 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:09.139709 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:09.139801 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:09.141018 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:09.141020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:09.141020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:09.141028 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:09.142582 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:09.143009 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:09.143010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:09.143010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:09.143073 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:09.143286 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:09.143286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:09.143287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:09.143399 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:09.143525 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:09.143624 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 04:55:09.143723 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:55:09.154403 15860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ade4e52646246e9bcde0bae3f94f329: Generated new TSK 0
I20260810 04:55:09.154704 15860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:09.158414 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 15738
2026-08-10T04:55:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1627 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:09 dist-test-slave-kvfs krb5kdc[15883](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:09 dist-test-slave-kvfs krb5kdc[15883](info): set up 2 sockets
Aug 10 04:55:09 dist-test-slave-kvfs krb5kdc[15883](info): commencing operation
krb5kdc: starting...
W20260810 04:55:10.490803 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:10 dist-test-slave-kvfs krb5kdc[15883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:10.639732 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39037
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:10.737560 15901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:10.737924 15901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:10.737984 15901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:10.739264 15901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:10.739339 15901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:10.739364 15901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:10.739387 15901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:10.739413 15901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:10.741125 15901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:10.741451 15901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:10.741745 15901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:10.747566 15910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:10.747637 15908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:10.747584 15906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:10.747740 15901 server_base.cc:1034] running on GCE node
I20260810 04:55:10.748255 15901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:10.748642 15901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:10.749842 15901 hybrid_clock.cc:648] HybridClock initialized: now 1786337710749819 us; error 42 us; skew 500 ppm
Aug 10 04:55:10 dist-test-slave-kvfs krb5kdc[15883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337710, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:10.753048 15901 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:10.753554 15901 webserver.cc:460] Webserver started at http://127.0.0.1:43289/ using document root <none> and password file <none>
I20260810 04:55:10.753870 15901 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:10.753923 15901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:10.754101 15901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:10.755414 15901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "77b5115940be4da3a5ef46452cdade6c"
format_stamp: "Formatted at 2026-08-10 04:55:10 on dist-test-slave-kvfs"
server_key: "91459c315fac859b5f9d1a06d38528a6"
server_key_iv: "3fe64a0239754831dffe0680f2f5110f"
server_key_version: "encryptionkey@0"
I20260810 04:55:10.755856 15901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "77b5115940be4da3a5ef46452cdade6c"
format_stamp: "Formatted at 2026-08-10 04:55:10 on dist-test-slave-kvfs"
server_key: "91459c315fac859b5f9d1a06d38528a6"
server_key_iv: "3fe64a0239754831dffe0680f2f5110f"
server_key_version: "encryptionkey@0"
I20260810 04:55:10.757488 15901 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:10.758424 15923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:10.758694 15901 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:10.758829 15901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "77b5115940be4da3a5ef46452cdade6c"
format_stamp: "Formatted at 2026-08-10 04:55:10 on dist-test-slave-kvfs"
server_key: "91459c315fac859b5f9d1a06d38528a6"
server_key_iv: "3fe64a0239754831dffe0680f2f5110f"
server_key_version: "encryptionkey@0"
I20260810 04:55:10.758919 15901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:10.779775 15901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:10.782542 15901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:10.782799 15901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:10.788791 15901 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39037
I20260810 04:55:10.788825 15998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39037 every 8 connection(s)
I20260810 04:55:10.789398 15901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:10.791163 15999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:10.795014 15999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c: Bootstrap starting.
I20260810 04:55:10.796221 15999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:10.796809 15999 log.cc:824] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:10.800628 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 15901
I20260810 04:55:10.800837 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:10.801084 16319 external_mini_cluster.cc:1428] Setting key bb6fb61b7586afb175b7302cf9af028c
I20260810 04:55:10.802621 15999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c: No bootstrap required, opened a new log
I20260810 04:55:10.805903 15999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b5115940be4da3a5ef46452cdade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260810 04:55:10.806198 15999 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:10.806241 15999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b5115940be4da3a5ef46452cdade6c, State: Initialized, Role: FOLLOWER
I20260810 04:55:10.806447 15999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b5115940be4da3a5ef46452cdade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260810 04:55:10.806565 15999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:10.806600 15999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:10.806655 15999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:10.807860 15999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b5115940be4da3a5ef46452cdade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260810 04:55:10.808005 15999 leader_election.cc:302] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77b5115940be4da3a5ef46452cdade6c; no voters:
I20260810 04:55:10.808296 15999 leader_election.cc:288] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:10.808321 16006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:10.808490 16006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [term 1 LEADER]: Becoming Leader. State: Replica: 77b5115940be4da3a5ef46452cdade6c, State: Running, Role: LEADER
I20260810 04:55:10.808651 16006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b5115940be4da3a5ef46452cdade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } }
I20260810 04:55:10.809139 16006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77b5115940be4da3a5ef46452cdade6c. Latest consensus state: current_term: 1 leader_uuid: "77b5115940be4da3a5ef46452cdade6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b5115940be4da3a5ef46452cdade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } } }
I20260810 04:55:10.809204 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:10.802157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37131 (local address 127.0.0.1:39037)
0810 04:55:10.802413 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:10.802425 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:10.802468 (+ 43us) server_negotiation.cc:407] Connection header received
0810 04:55:10.803273 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:10.803286 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:10.803383 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:10.803582 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:10.803877 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:10.805071 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:10.806365 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:10.807104 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:10.807241 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:10.808195 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:10.808200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:10.808201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:10.808495 (+ 294us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:10.808554 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:10.808574 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:10.808633 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:10.808871 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 04:55:10.808956 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":112,"threads_started":1}
I20260810 04:55:10.808684 15999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:10.809182 16007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77b5115940be4da3a5ef46452cdade6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b5115940be4da3a5ef46452cdade6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39037 } } }
I20260810 04:55:10.809278 16006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:10.809585 16007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:10.810189 16013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:10.810598 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:10.810868 16013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:10.812887 16013 catalog_manager.cc:1347] Generated new cluster ID: 127159a3a8664f2e835503362ec94c53
I20260810 04:55:10.812951 16013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:10.819293 16013 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:10.820027 16013 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:10.820560 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:10.812791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59239 (local address 127.0.0.1:39037)
0810 04:55:10.812832 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:10.812834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:10.816386 (+ 3552us) server_negotiation.cc:407] Connection header received
0810 04:55:10.816444 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:10.816445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:10.816462 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:10.816543 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:10.816735 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:10.817656 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:10.818728 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:10.819115 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:10.819199 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:10.820244 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:10.820246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:10.820246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:10.820253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:10.820275 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:10.820279 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:10.820339 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:10.820421 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 04:55:10.820465 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:55:10.828171 16013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77b5115940be4da3a5ef46452cdade6c: Generated new TSK 0
I20260810 04:55:10.828461 16013 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:10.832978 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 15901
2026-08-10T04:55:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1679 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:10 dist-test-slave-kvfs krb5kdc[16050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:10 dist-test-slave-kvfs krb5kdc[16050](info): set up 2 sockets
Aug 10 04:55:10 dist-test-slave-kvfs krb5kdc[16050](info): commencing operation
krb5kdc: starting...
W20260810 04:55:12.149323 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:12 dist-test-slave-kvfs krb5kdc[16050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:12.296969 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43955
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:12.396620 16073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:12.396921 16073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:12.396961 16073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:12.398356 16073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:12.398440 16073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:12.398465 16073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:12.398499 16073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:12.398530 16073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:12.400287 16073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:12.400655 16073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:12.400961 16073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:12.406949 16079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:12.406963 16080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:12.406963 16082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:12.407003 16073 server_base.cc:1034] running on GCE node
I20260810 04:55:12.407513 16073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:12.407860 16073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:12.409035 16073 hybrid_clock.cc:648] HybridClock initialized: now 1786337712409022 us; error 34 us; skew 500 ppm
Aug 10 04:55:12 dist-test-slave-kvfs krb5kdc[16050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337712, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:12.412179 16073 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:12.412726 16073 webserver.cc:460] Webserver started at http://127.0.0.1:40087/ using document root <none> and password file <none>
I20260810 04:55:12.413044 16073 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:12.413123 16073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:12.413305 16073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:12.414635 16073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42"
format_stamp: "Formatted at 2026-08-10 04:55:12 on dist-test-slave-kvfs"
server_key: "47370683265d9de87ee8e3899730baf1"
server_key_iv: "a27b856a66bbaf60b1422a4cf223b045"
server_key_version: "encryptionkey@0"
I20260810 04:55:12.415082 16073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42"
format_stamp: "Formatted at 2026-08-10 04:55:12 on dist-test-slave-kvfs"
server_key: "47370683265d9de87ee8e3899730baf1"
server_key_iv: "a27b856a66bbaf60b1422a4cf223b045"
server_key_version: "encryptionkey@0"
I20260810 04:55:12.416910 16073 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 04:55:12.417917 16093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:12.418200 16073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:12.418339 16073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42"
format_stamp: "Formatted at 2026-08-10 04:55:12 on dist-test-slave-kvfs"
server_key: "47370683265d9de87ee8e3899730baf1"
server_key_iv: "a27b856a66bbaf60b1422a4cf223b045"
server_key_version: "encryptionkey@0"
I20260810 04:55:12.418455 16073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:12.422497 16073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:12.425168 16073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:12.425401 16073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:12.430857 16073 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43955
I20260810 04:55:12.430899 16167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43955 every 8 connection(s)
I20260810 04:55:12.431358 16073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:12.432763 16168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:12.435230 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16073
I20260810 04:55:12.435372 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:12.435595 16319 external_mini_cluster.cc:1428] Setting key 6d1d2ca90c77b7c254c2c9a3bd1a90db
I20260810 04:55:12.435868 16168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42: Bootstrap starting.
I20260810 04:55:12.436786 16168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:12.437153 16168 log.cc:824] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:12.438139 16168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42: No bootstrap required, opened a new log
I20260810 04:55:12.438701 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:12.436322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46755 (local address 127.0.0.1:43955)
0810 04:55:12.436562 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:12.436572 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:12.436602 (+ 30us) server_negotiation.cc:407] Connection header received
0810 04:55:12.437172 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:12.437181 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:12.437239 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:12.437410 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:12.438175 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:12.438180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:12.438180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:12.438185 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:12.438238 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:12.438258 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:12.438352 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:12.438410 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 04:55:12.438464 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":111,"threads_started":1}
I20260810 04:55:12.439877 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:12.440781 16168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43955 } }
I20260810 04:55:12.441013 16168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:12.441057 16168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e21ad1fe9f64f8096f5d1af29cd5d42, State: Initialized, Role: FOLLOWER
I20260810 04:55:12.441192 16168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43955 } }
I20260810 04:55:12.441299 16168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:12.441339 16168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:12.441406 16168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:12.442348 16168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43955 } }
I20260810 04:55:12.442488 16168 leader_election.cc:302] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e21ad1fe9f64f8096f5d1af29cd5d42; no voters:
I20260810 04:55:12.442715 16168 leader_election.cc:288] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:12.442736 16180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:12.442883 16180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [term 1 LEADER]: Becoming Leader. State: Replica: 0e21ad1fe9f64f8096f5d1af29cd5d42, State: Running, Role: LEADER
I20260810 04:55:12.442978 16180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43955 } }
I20260810 04:55:12.443034 16168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:12.443352 16180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e21ad1fe9f64f8096f5d1af29cd5d42. Latest consensus state: current_term: 1 leader_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43955 } } }
I20260810 04:55:12.443450 16180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:12.443537 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:12.441987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46191 (local address 127.0.0.1:43955)
0810 04:55:12.442039 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:12.442041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:12.442195 (+ 154us) server_negotiation.cc:407] Connection header received
0810 04:55:12.442288 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:12.442289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:12.442294 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:12.442345 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:12.443144 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:12.443146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:12.443147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:12.443151 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:12.443168 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:12.443173 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:12.443248 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:12.443380 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 04:55:12.443396 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:55:12.443704 16192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:12.443365 16186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e21ad1fe9f64f8096f5d1af29cd5d42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43955 } } }
I20260810 04:55:12.444075 16186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:12.444453 16192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:12.445871 16210 mvcc.cc:205] Tried to move back new op lower bound from 7316839270176813056 to 7316839270166872064. Current Snapshot: MvccSnapshot[applied={T|T < 7316839270176813056}]
I20260810 04:55:12.448724 16192 catalog_manager.cc:1347] Generated new cluster ID: 5e59ce1afb004098a18fe4cc085753c6
I20260810 04:55:12.448789 16192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:12.463747 16192 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:12.463994 16192 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:12.468230 16192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e21ad1fe9f64f8096f5d1af29cd5d42: Generated new TSK 0
I20260810 04:55:12.468472 16192 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:12.471258 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16073
2026-08-10T04:55:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1633 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:12 dist-test-slave-kvfs krb5kdc[16215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:12 dist-test-slave-kvfs krb5kdc[16215](info): set up 2 sockets
Aug 10 04:55:12 dist-test-slave-kvfs krb5kdc[16215](info): commencing operation
krb5kdc: starting...
W20260810 04:55:13.772665 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:13 dist-test-slave-kvfs krb5kdc[16215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:13.931697 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39625
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:14.033869 16232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:14.034215 16232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:14.034261 16232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:14.035657 16232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:14.035748 16232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:14.035773 16232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:14.035794 16232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:14.035823 16232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:14.037671 16232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:14.038034 16232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:14.038335 16232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:55:14.044703 16232 server_base.cc:1034] running on GCE node
W20260810 04:55:14.044667 16246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:14.044667 16241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:14.044667 16243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:14.045322 16232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:14.045697 16232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:14.046919 16232 hybrid_clock.cc:648] HybridClock initialized: now 1786337714046886 us; error 64 us; skew 500 ppm
Aug 10 04:55:14 dist-test-slave-kvfs krb5kdc[16215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337714, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:14.050269 16232 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:14.050868 16232 webserver.cc:460] Webserver started at http://127.0.0.1:40735/ using document root <none> and password file <none>
I20260810 04:55:14.051151 16232 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:14.051226 16232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:14.051409 16232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:14.052809 16232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "7c1121bef1a54a39a896ac85c448c00c"
format_stamp: "Formatted at 2026-08-10 04:55:14 on dist-test-slave-kvfs"
server_key: "847f08b2f91788b9cee3eba6eb68a099"
server_key_iv: "3815b1a737636e6cca9f987b4ae5fca5"
server_key_version: "encryptionkey@0"
I20260810 04:55:14.053232 16232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "7c1121bef1a54a39a896ac85c448c00c"
format_stamp: "Formatted at 2026-08-10 04:55:14 on dist-test-slave-kvfs"
server_key: "847f08b2f91788b9cee3eba6eb68a099"
server_key_iv: "3815b1a737636e6cca9f987b4ae5fca5"
server_key_version: "encryptionkey@0"
I20260810 04:55:14.054875 16232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:55:14.055833 16257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:14.056095 16232 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:14.056226 16232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "7c1121bef1a54a39a896ac85c448c00c"
format_stamp: "Formatted at 2026-08-10 04:55:14 on dist-test-slave-kvfs"
server_key: "847f08b2f91788b9cee3eba6eb68a099"
server_key_iv: "3815b1a737636e6cca9f987b4ae5fca5"
server_key_version: "encryptionkey@0"
I20260810 04:55:14.056314 16232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:14.065029 16232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:14.067507 16232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:14.067718 16232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:14.076454 16232 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39625
I20260810 04:55:14.076494 16341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39625 every 8 connection(s)
I20260810 04:55:14.076954 16232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:14.078105 16343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:14.080324 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16232
I20260810 04:55:14.080492 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:14.080717 16319 external_mini_cluster.cc:1428] Setting key ae552298d33da293e4c9c18cc1428ab3
I20260810 04:55:14.081555 16343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c: Bootstrap starting.
I20260810 04:55:14.082507 16343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:14.082901 16343 log.cc:824] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:14.083774 16343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c: No bootstrap required, opened a new log
I20260810 04:55:14.086426 16343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c1121bef1a54a39a896ac85c448c00c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260810 04:55:14.086632 16343 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:14.086669 16343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c1121bef1a54a39a896ac85c448c00c, State: Initialized, Role: FOLLOWER
I20260810 04:55:14.086826 16343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c1121bef1a54a39a896ac85c448c00c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260810 04:55:14.086936 16343 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:14.086971 16343 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:14.087061 16343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:14.087996 16343 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c1121bef1a54a39a896ac85c448c00c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260810 04:55:14.088207 16343 leader_election.cc:302] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c1121bef1a54a39a896ac85c448c00c; no voters:
I20260810 04:55:14.088434 16343 leader_election.cc:288] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:14.088501 16350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:14.088750 16350 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [term 1 LEADER]: Becoming Leader. State: Replica: 7c1121bef1a54a39a896ac85c448c00c, State: Running, Role: LEADER
I20260810 04:55:14.088761 16343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:14.088938 16350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c1121bef1a54a39a896ac85c448c00c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } }
I20260810 04:55:14.089418 16351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c1121bef1a54a39a896ac85c448c00c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c1121bef1a54a39a896ac85c448c00c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } } }
I20260810 04:55:14.089465 16352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c1121bef1a54a39a896ac85c448c00c. Latest consensus state: current_term: 1 leader_uuid: "7c1121bef1a54a39a896ac85c448c00c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c1121bef1a54a39a896ac85c448c00c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39625 } } }
I20260810 04:55:14.089536 16351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:14.089548 16352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:14.089846 16360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:14.090520 16360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:14.093259 16360 catalog_manager.cc:1347] Generated new cluster ID: d1ff60b8ef1c4e618caf4cba95a0fd8b
I20260810 04:55:14.093317 16360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:55:14 dist-test-slave-kvfs krb5kdc[16215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:55:14.098924 16347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:14.081479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:59777 (local address 127.0.0.1:39625)
0810 04:55:14.081774 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:14.081784 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:14.081820 (+ 36us) server_negotiation.cc:407] Connection header received
0810 04:55:14.082629 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:14.082642 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:14.082742 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:14.082919 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:14.083697 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:14.085216 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:14.086091 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:14.086783 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:14.086897 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:14.094161 (+ 7264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:14.094167 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:14.094167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:14.094182 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:14.096594 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:14.097238 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:14.097242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:14.097243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:14.097370 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:14.097744 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:14.097745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:14.097745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:14.098185 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:14.098396 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:14.098513 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 04:55:14.098665 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":84,"threads_started":1}
I20260810 04:55:14.100106 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:14.110208 16347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:14.101877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:58603 (local address 127.0.0.1:39625)
0810 04:55:14.101919 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:14.101922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:14.102183 (+ 261us) server_negotiation.cc:407] Connection header received
0810 04:55:14.102217 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:14.102218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:14.102231 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:14.102298 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:14.102965 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:14.103816 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:14.104865 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:14.105238 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:14.105316 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:14.106914 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:14.106916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:14.106916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:14.106925 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:14.108732 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:14.109186 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:14.109188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:14.109189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:14.109256 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:14.109499 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:14.109500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:14.109500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:14.109654 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:14.109774 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:14.109893 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 04:55:14.109962 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 04:55:14.127285 16360 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:14.127995 16360 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:14.133981 16360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c1121bef1a54a39a896ac85c448c00c: Generated new TSK 0
I20260810 04:55:14.134256 16360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:14.144825 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16232
W20260810 04:55:14.173203 16212 connection.cc:535] client connection to 127.0.0.1:39625 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39625): Connection reset by peer (error 104)
2026-08-10T04:55:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1682 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:14 dist-test-slave-kvfs krb5kdc[16384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:14 dist-test-slave-kvfs krb5kdc[16384](info): set up 2 sockets
Aug 10 04:55:14 dist-test-slave-kvfs krb5kdc[16384](info): commencing operation
krb5kdc: starting...
W20260810 04:55:15.481693 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:15 dist-test-slave-kvfs krb5kdc[16384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:15.639580 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:15.738229 16409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:15.738510 16409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:15.738538 16409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:15.739843 16409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:15.739902 16409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:15.739918 16409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:15.739931 16409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:15.739943 16409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:15.741647 16409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:15.741969 16409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:15.742259 16409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:15.748463 16418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:15.748463 16419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:15.748517 16422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:15.749008 16409 server_base.cc:1034] running on GCE node
I20260810 04:55:15.749366 16409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:15.749776 16409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:15.751031 16409 hybrid_clock.cc:648] HybridClock initialized: now 1786337715750999 us; error 91 us; skew 500 ppm
Aug 10 04:55:15 dist-test-slave-kvfs krb5kdc[16384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337715, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:15.754592 16409 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:15.755249 16409 webserver.cc:460] Webserver started at http://127.0.0.1:33031/ using document root <none> and password file <none>
I20260810 04:55:15.755535 16409 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:15.755609 16409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:15.755779 16409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:15.757182 16409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "462699007cf34bacb82838cfed7b112b"
format_stamp: "Formatted at 2026-08-10 04:55:15 on dist-test-slave-kvfs"
server_key: "23c429438bdc8301b9cde05837ebbdb9"
server_key_iv: "935c63159765129eab5d0249fc6f7135"
server_key_version: "encryptionkey@0"
I20260810 04:55:15.757625 16409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "462699007cf34bacb82838cfed7b112b"
format_stamp: "Formatted at 2026-08-10 04:55:15 on dist-test-slave-kvfs"
server_key: "23c429438bdc8301b9cde05837ebbdb9"
server_key_iv: "935c63159765129eab5d0249fc6f7135"
server_key_version: "encryptionkey@0"
I20260810 04:55:15.759342 16409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 04:55:15.760352 16433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:15.760635 16409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:15.760772 16409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "462699007cf34bacb82838cfed7b112b"
format_stamp: "Formatted at 2026-08-10 04:55:15 on dist-test-slave-kvfs"
server_key: "23c429438bdc8301b9cde05837ebbdb9"
server_key_iv: "935c63159765129eab5d0249fc6f7135"
server_key_version: "encryptionkey@0"
I20260810 04:55:15.760885 16409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:15.786818 16409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:15.789592 16409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:15.789795 16409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:15.795261 16409 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42175
I20260810 04:55:15.795301 16504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42175 every 8 connection(s)
I20260810 04:55:15.795773 16409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:15.796976 16505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:15.798097 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16409
I20260810 04:55:15.798228 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:15.798465 16319 external_mini_cluster.cc:1428] Setting key 09ee0369a1f6a92b93e7ca721dc19793
I20260810 04:55:15.800968 16505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b: Bootstrap starting.
I20260810 04:55:15.801810 16505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:15.802179 16505 log.cc:824] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:15.803011 16505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b: No bootstrap required, opened a new log
I20260810 04:55:15.805303 16512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:15.799181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:45605 (local address 127.0.0.1:42175)
0810 04:55:15.799386 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:15.799397 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:15.799429 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:55:15.799930 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:15.799938 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:15.800049 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:15.800189 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:15.800470 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:15.801553 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:15.802736 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:15.803266 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:15.803358 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:15.804327 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:15.804332 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:15.804332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:15.804640 (+ 308us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:15.804693 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:15.804710 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:15.804833 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:15.804981 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 04:55:15.805017 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260810 04:55:15.806068 16505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "462699007cf34bacb82838cfed7b112b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260810 04:55:15.806281 16505 raft_consensus.cc:374] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:15.806336 16505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462699007cf34bacb82838cfed7b112b, State: Initialized, Role: FOLLOWER
I20260810 04:55:15.806512 16505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "462699007cf34bacb82838cfed7b112b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260810 04:55:15.806716 16505 raft_consensus.cc:388] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:15.806773 16505 raft_consensus.cc:482] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:15.806834 16505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:15.807034 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:15.807686 16505 raft_consensus.cc:504] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "462699007cf34bacb82838cfed7b112b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260810 04:55:15.807816 16505 leader_election.cc:302] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 462699007cf34bacb82838cfed7b112b; no voters:
I20260810 04:55:15.808009 16505 leader_election.cc:288] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:15.808117 16514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:15.808318 16514 raft_consensus.cc:686] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [term 1 LEADER]: Becoming Leader. State: Replica: 462699007cf34bacb82838cfed7b112b, State: Running, Role: LEADER
I20260810 04:55:15.808341 16505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:15.808436 16514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "462699007cf34bacb82838cfed7b112b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260810 04:55:15.808858 16514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "462699007cf34bacb82838cfed7b112b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "462699007cf34bacb82838cfed7b112b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } } }
I20260810 04:55:15.808943 16514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:15.809098 16514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 462699007cf34bacb82838cfed7b112b. Latest consensus state: current_term: 1 leader_uuid: "462699007cf34bacb82838cfed7b112b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "462699007cf34bacb82838cfed7b112b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } } }
I20260810 04:55:15.809160 16514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b [sys.catalog]: This master's current role is: LEADER
W20260810 04:55:15.810864 16552 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:15.810931 16552 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:15.811113 16534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:15.811312 16534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:15.813776 16534 catalog_manager.cc:1347] Generated new cluster ID: 09a9e8a4ddb4468691c66407a98789ee
I20260810 04:55:15.813843 16534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:15.814148 16512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:15.809550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:54551 (local address 127.0.0.1:42175)
0810 04:55:15.809774 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:15.809776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:15.809996 (+ 220us) server_negotiation.cc:407] Connection header received
0810 04:55:15.810178 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:15.810179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:15.810192 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:15.810226 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:15.810469 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:15.811289 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:15.812444 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:15.812728 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:15.812819 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:15.813777 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:15.813779 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:15.813779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:15.813785 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:15.813805 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:15.813810 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:15.813847 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:15.814034 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 04:55:15.814060 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260810 04:55:15.840050 16534 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:15.840946 16534 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:15.851089 16534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 462699007cf34bacb82838cfed7b112b: Generated new TSK 0
I20260810 04:55:15.851359 16534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:15.857889 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16409
W20260810 04:55:15.883255 16380 connection.cc:535] client connection to 127.0.0.1:42175 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42175): Connection reset by peer (error 104)
2026-08-10T04:55:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1710 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:15 dist-test-slave-kvfs krb5kdc[16562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:15 dist-test-slave-kvfs krb5kdc[16562](info): set up 2 sockets
Aug 10 04:55:15 dist-test-slave-kvfs krb5kdc[16562](info): commencing operation
krb5kdc: starting...
W20260810 04:55:17.173651 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:17 dist-test-slave-kvfs krb5kdc[16562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:17.333168 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44041
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:17.458084 16583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:17.458356 16583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:17.458384 16583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:17.459656 16583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:17.459705 16583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:17.459721 16583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:17.459781 16583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:17.459810 16583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:17.461587 16583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:17.461906 16583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:17.462204 16583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:17.468065 16588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:17.468096 16589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:17.468115 16591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:17.468444 16583 server_base.cc:1034] running on GCE node
I20260810 04:55:17.468750 16583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:17.469110 16583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:17.470269 16583 hybrid_clock.cc:648] HybridClock initialized: now 1786337717470222 us; error 66 us; skew 500 ppm
Aug 10 04:55:17 dist-test-slave-kvfs krb5kdc[16562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337717, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:17.473443 16583 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:17.474014 16583 webserver.cc:460] Webserver started at http://127.0.0.1:42501/ using document root <none> and password file <none>
I20260810 04:55:17.474267 16583 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:17.474310 16583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:17.474417 16583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:17.475605 16583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "8bf8a069db654795b0d8a6740ea7408c"
format_stamp: "Formatted at 2026-08-10 04:55:17 on dist-test-slave-kvfs"
server_key: "2cdec08c093c17f29d16d39f5333a70c"
server_key_iv: "85ad4f4903794825e7dd23da402347c7"
server_key_version: "encryptionkey@0"
I20260810 04:55:17.475968 16583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "8bf8a069db654795b0d8a6740ea7408c"
format_stamp: "Formatted at 2026-08-10 04:55:17 on dist-test-slave-kvfs"
server_key: "2cdec08c093c17f29d16d39f5333a70c"
server_key_iv: "85ad4f4903794825e7dd23da402347c7"
server_key_version: "encryptionkey@0"
I20260810 04:55:17.477478 16583 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:17.478266 16599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:17.478483 16583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:17.478574 16583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "8bf8a069db654795b0d8a6740ea7408c"
format_stamp: "Formatted at 2026-08-10 04:55:17 on dist-test-slave-kvfs"
server_key: "2cdec08c093c17f29d16d39f5333a70c"
server_key_iv: "85ad4f4903794825e7dd23da402347c7"
server_key_version: "encryptionkey@0"
I20260810 04:55:17.478633 16583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:17.482376 16583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:17.485064 16583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:17.485184 16583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:17.490221 16583 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44041
I20260810 04:55:17.490255 16672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44041 every 8 connection(s)
I20260810 04:55:17.490653 16583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:17.491959 16675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:17.494083 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16583
I20260810 04:55:17.494228 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:17.494453 16319 external_mini_cluster.cc:1428] Setting key 06f4eaa623163dd8b73cf9b579198d26
I20260810 04:55:17.495131 16675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c: Bootstrap starting.
I20260810 04:55:17.496013 16675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:17.496428 16675 log.cc:824] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:17.497306 16675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c: No bootstrap required, opened a new log
I20260810 04:55:17.497751 16681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:17.495092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:45889 (local address 127.0.0.1:44041)
0810 04:55:17.495327 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:17.495338 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:17.495375 (+ 37us) server_negotiation.cc:407] Connection header received
0810 04:55:17.496156 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:17.496170 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:17.496223 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:17.496434 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:17.497257 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:17.497261 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:17.497262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:17.497267 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:17.497319 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:17.497336 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:17.497449 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:17.497493 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 04:55:17.497542 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
I20260810 04:55:17.498919 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:17.500154 16675 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bf8a069db654795b0d8a6740ea7408c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260810 04:55:17.500363 16675 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:17.500416 16675 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf8a069db654795b0d8a6740ea7408c, State: Initialized, Role: FOLLOWER
I20260810 04:55:17.500581 16675 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bf8a069db654795b0d8a6740ea7408c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260810 04:55:17.500697 16675 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:17.500736 16675 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:17.500790 16675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:17.501686 16675 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bf8a069db654795b0d8a6740ea7408c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260810 04:55:17.501824 16675 leader_election.cc:302] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bf8a069db654795b0d8a6740ea7408c; no voters:
I20260810 04:55:17.502029 16681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:17.500908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:48269 (local address 127.0.0.1:44041)
0810 04:55:17.500955 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:17.500957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:17.501097 (+ 140us) server_negotiation.cc:407] Connection header received
0810 04:55:17.501160 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:17.501161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:17.501165 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:17.501208 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:17.501748 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:17.501749 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:17.501749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:17.501753 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:17.501767 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:17.501771 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:17.501844 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:17.501907 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 04:55:17.501922 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:55:17.502075 16675 leader_election.cc:288] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:17.502116 16693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:17.502266 16693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [term 1 LEADER]: Becoming Leader. State: Replica: 8bf8a069db654795b0d8a6740ea7408c, State: Running, Role: LEADER
I20260810 04:55:17.502386 16675 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:17.502357 16693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bf8a069db654795b0d8a6740ea7408c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } }
I20260810 04:55:17.502849 16693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bf8a069db654795b0d8a6740ea7408c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bf8a069db654795b0d8a6740ea7408c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } } }
I20260810 04:55:17.502948 16693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:17.503108 16693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bf8a069db654795b0d8a6740ea7408c. Latest consensus state: current_term: 1 leader_uuid: "8bf8a069db654795b0d8a6740ea7408c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bf8a069db654795b0d8a6740ea7408c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44041 } } }
I20260810 04:55:17.503182 16693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:17.503443 16702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:17.504114 16702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:17.509485 16702 catalog_manager.cc:1347] Generated new cluster ID: 8e2c361864f44e49a987fae9be28f85f
I20260810 04:55:17.509588 16702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:17.526340 16702 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:17.526633 16702 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:17.533499 16702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bf8a069db654795b0d8a6740ea7408c: Generated new TSK 0
I20260810 04:55:17.533758 16702 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:17.539160 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16583
2026-08-10T04:55:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1678 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:17 dist-test-slave-kvfs krb5kdc[16724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:17 dist-test-slave-kvfs krb5kdc[16724](info): set up 2 sockets
Aug 10 04:55:17 dist-test-slave-kvfs krb5kdc[16724](info): commencing operation
krb5kdc: starting...
W20260810 04:55:18.841403 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:18 dist-test-slave-kvfs krb5kdc[16724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:18.993487 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35997
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:19.088976 16740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:19.089241 16740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:19.089264 16740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:19.090530 16740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:19.090581 16740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:19.090596 16740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:19.090610 16740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:19.090621 16740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:19.092325 16740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35997
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:19.092674 16740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:19.092962 16740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:19.098800 16747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:19.098858 16749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:19.099116 16740 server_base.cc:1034] running on GCE node
W20260810 04:55:19.098899 16751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:19.099462 16740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:19.099819 16740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:19.101004 16740 hybrid_clock.cc:648] HybridClock initialized: now 1786337719100976 us; error 44 us; skew 500 ppm
Aug 10 04:55:19 dist-test-slave-kvfs krb5kdc[16724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337719, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:19.108328 16740 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:19.108914 16740 webserver.cc:460] Webserver started at http://127.0.0.1:44169/ using document root <none> and password file <none>
I20260810 04:55:19.109201 16740 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:19.109254 16740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:19.109452 16740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:19.110800 16740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "29e9a2946d1447a9b1fa1a321d912ae5"
format_stamp: "Formatted at 2026-08-10 04:55:19 on dist-test-slave-kvfs"
server_key: "e2402dc8ce7589c12657e511efc1255a"
server_key_iv: "e5f82cf26dd71a658d00f5b2291b7011"
server_key_version: "encryptionkey@0"
I20260810 04:55:19.111227 16740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "29e9a2946d1447a9b1fa1a321d912ae5"
format_stamp: "Formatted at 2026-08-10 04:55:19 on dist-test-slave-kvfs"
server_key: "e2402dc8ce7589c12657e511efc1255a"
server_key_iv: "e5f82cf26dd71a658d00f5b2291b7011"
server_key_version: "encryptionkey@0"
I20260810 04:55:19.113035 16740 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 04:55:19.113962 16761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:19.114200 16740 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:19.114324 16740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "29e9a2946d1447a9b1fa1a321d912ae5"
format_stamp: "Formatted at 2026-08-10 04:55:19 on dist-test-slave-kvfs"
server_key: "e2402dc8ce7589c12657e511efc1255a"
server_key_iv: "e5f82cf26dd71a658d00f5b2291b7011"
server_key_version: "encryptionkey@0"
I20260810 04:55:19.114414 16740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:19.125895 16740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:19.128705 16740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:19.128901 16740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:19.134132 16740 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35997
I20260810 04:55:19.134173 16834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35997 every 8 connection(s)
I20260810 04:55:19.134644 16740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:19.135820 16835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:19.138896 16835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5: Bootstrap starting.
I20260810 04:55:19.139703 16835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:19.140136 16835 log.cc:824] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:19.141053 16835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5: No bootstrap required, opened a new log
I20260810 04:55:19.141287 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16740
I20260810 04:55:19.141443 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:19.141644 16319 external_mini_cluster.cc:1428] Setting key c86a07e2e45fa3eb0c7dcf3bc5eb0f70
I20260810 04:55:19.143496 16835 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 04:55:19.143714 16835 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:19.143764 16835 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29e9a2946d1447a9b1fa1a321d912ae5, State: Initialized, Role: FOLLOWER
I20260810 04:55:19.143924 16835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 04:55:19.144055 16835 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:19.144111 16835 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:19.144174 16835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:19.145467 16835 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 04:55:19.145627 16835 leader_election.cc:302] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29e9a2946d1447a9b1fa1a321d912ae5; no voters:
I20260810 04:55:19.145861 16835 leader_election.cc:288] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:19.145887 16842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:19.146029 16842 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 29e9a2946d1447a9b1fa1a321d912ae5, State: Running, Role: LEADER
I20260810 04:55:19.146130 16842 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 04:55:19.146209 16835 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:19.146531 16844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } } }
I20260810 04:55:19.146651 16844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:19.146865 16843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29e9a2946d1447a9b1fa1a321d912ae5. Latest consensus state: current_term: 1 leader_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e9a2946d1447a9b1fa1a321d912ae5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } } }
I20260810 04:55:19.146941 16843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:19.147087 16848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:19.147698 16848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:19.150525 16848 catalog_manager.cc:1347] Generated new cluster ID: 33b0f56a59da413087779b8edd9a471a
I20260810 04:55:19.150586 16848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 04:55:19 dist-test-slave-kvfs krb5kdc[16724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 04:55:19.156342 16840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:19.142322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:38565 (local address 127.0.0.1:35997)
0810 04:55:19.142544 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:19.142554 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:19.142585 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:55:19.143464 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:19.143473 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:19.143533 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:19.143671 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:19.144765 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:19.145976 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:19.147222 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:19.147915 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:19.148072 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:19.151668 (+ 3596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:19.151673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:19.151673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:19.151688 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:19.154074 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:19.154578 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:19.154582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:19.154582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:19.154759 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:19.155019 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:19.155020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:19.155020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:19.155409 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:19.155621 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:19.155718 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 04:55:19.155850 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":115,"threads_started":1}
I20260810 04:55:19.157692 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:19.167197 16848 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:19.168148 16848 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:19.168272 16840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:19.159645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:35609 (local address 127.0.0.1:35997)
0810 04:55:19.159687 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:19.159688 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:19.159727 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:55:19.159816 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:19.159818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:19.159831 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:19.159929 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:19.160670 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:19.161452 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:19.162491 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:19.162829 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:19.162920 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:19.164470 (+ 1550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:19.164471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:19.164472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:19.164480 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:19.166311 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:19.166998 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:19.166999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:19.167000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:19.167083 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:19.167402 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:19.167403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:19.167403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:19.167549 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:19.167637 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:19.168037 (+ 400us) server_negotiation.cc:299] Negotiation successful
0810 04:55:19.168118 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 04:55:19.172307 16848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29e9a2946d1447a9b1fa1a321d912ae5: Generated new TSK 0
I20260810 04:55:19.172562 16848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:19.174561 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16740
W20260810 04:55:19.196986 16722 connection.cc:535] client connection to 127.0.0.1:35997 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35997): Connection reset by peer (error 104)
2026-08-10T04:55:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1634 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:19 dist-test-slave-kvfs krb5kdc[16881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:19 dist-test-slave-kvfs krb5kdc[16881](info): set up 2 sockets
Aug 10 04:55:19 dist-test-slave-kvfs krb5kdc[16881](info): commencing operation
krb5kdc: starting...
W20260810 04:55:20.474365 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:20 dist-test-slave-kvfs krb5kdc[16881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:20.624267 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36455
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:20.722783 16898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:20.723057 16898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:20.723083 16898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:20.724489 16898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:20.724541 16898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:20.724557 16898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:20.724570 16898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:20.724582 16898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:20.726246 16898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36455
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:20.726572 16898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:20.726866 16898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:20.732667 16906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:20.732667 16909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:20.732689 16905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:20.733040 16898 server_base.cc:1034] running on GCE node
I20260810 04:55:20.733431 16898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:20.733742 16898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:20.734894 16898 hybrid_clock.cc:648] HybridClock initialized: now 1786337720734870 us; error 39 us; skew 500 ppm
Aug 10 04:55:20 dist-test-slave-kvfs krb5kdc[16881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337720, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:20.737995 16898 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:20.738528 16898 webserver.cc:460] Webserver started at http://127.0.0.1:38223/ using document root <none> and password file <none>
I20260810 04:55:20.738821 16898 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:20.738893 16898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:20.739056 16898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:20.740410 16898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "08b0afa62c7146448533f7dca45cb900"
format_stamp: "Formatted at 2026-08-10 04:55:20 on dist-test-slave-kvfs"
server_key: "712483184a4fcf6923afb4f0a6a701f9"
server_key_iv: "219e518ef640a8a4544f2afb0c8f2bae"
server_key_version: "encryptionkey@0"
I20260810 04:55:20.740818 16898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "08b0afa62c7146448533f7dca45cb900"
format_stamp: "Formatted at 2026-08-10 04:55:20 on dist-test-slave-kvfs"
server_key: "712483184a4fcf6923afb4f0a6a701f9"
server_key_iv: "219e518ef640a8a4544f2afb0c8f2bae"
server_key_version: "encryptionkey@0"
I20260810 04:55:20.742293 16898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:55:20.743144 16919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:20.743350 16898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:20.743479 16898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "08b0afa62c7146448533f7dca45cb900"
format_stamp: "Formatted at 2026-08-10 04:55:20 on dist-test-slave-kvfs"
server_key: "712483184a4fcf6923afb4f0a6a701f9"
server_key_iv: "219e518ef640a8a4544f2afb0c8f2bae"
server_key_version: "encryptionkey@0"
I20260810 04:55:20.743558 16898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:20.763576 16898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:20.766422 16898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:20.766609 16898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:20.771726 16898 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36455
I20260810 04:55:20.771772 17003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36455 every 8 connection(s)
I20260810 04:55:20.772306 16898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:20.773542 17005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:20.776521 17005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900: Bootstrap starting.
I20260810 04:55:20.777300 17005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:20.777657 17005 log.cc:824] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:20.778644 17005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900: No bootstrap required, opened a new log
I20260810 04:55:20.780735 17005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b0afa62c7146448533f7dca45cb900" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36455 } }
I20260810 04:55:20.780936 17005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:20.780963 17005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b0afa62c7146448533f7dca45cb900, State: Initialized, Role: FOLLOWER
I20260810 04:55:20.781170 17005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b0afa62c7146448533f7dca45cb900" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36455 } }
I20260810 04:55:20.781252 17005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:20.781282 17005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:20.781366 17005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:20.782109 17005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b0afa62c7146448533f7dca45cb900" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36455 } }
I20260810 04:55:20.782218 17005 leader_election.cc:302] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08b0afa62c7146448533f7dca45cb900; no voters:
I20260810 04:55:20.782395 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 16898
I20260810 04:55:20.782529 17005 leader_election.cc:288] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:20.782547 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:20.782577 17008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:20.782783 17008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [term 1 LEADER]: Becoming Leader. State: Replica: 08b0afa62c7146448533f7dca45cb900, State: Running, Role: LEADER
I20260810 04:55:20.782827 16319 external_mini_cluster.cc:1428] Setting key 5b0ea9326065e54309859eda8c8d2bd3
I20260810 04:55:20.782922 17005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:20.782948 17008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b0afa62c7146448533f7dca45cb900" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36455 } }
I20260810 04:55:20.783638 17010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08b0afa62c7146448533f7dca45cb900. Latest consensus state: current_term: 1 leader_uuid: "08b0afa62c7146448533f7dca45cb900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b0afa62c7146448533f7dca45cb900" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36455 } } }
I20260810 04:55:20.783738 17010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:20.784220 17009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08b0afa62c7146448533f7dca45cb900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08b0afa62c7146448533f7dca45cb900" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36455 } } }
I20260810 04:55:20.784349 17009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:20.784598 17026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:20.785416 17026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:20.787506 17026 catalog_manager.cc:1347] Generated new cluster ID: 02a5a61ba2ba4142b8e4d89cb1275edf
I20260810 04:55:20.787596 17026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:20.791077 17025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:20.783663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:36905 (local address 127.0.0.1:36455)
0810 04:55:20.784506 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:20.784521 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:20.784568 (+ 47us) server_negotiation.cc:407] Connection header received
0810 04:55:20.784800 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:20.784810 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:20.784995 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:20.785194 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:20.785584 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:20.787027 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:20.788280 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:20.789056 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:20.789183 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:20.790150 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:20.790155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:20.790156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:20.790438 (+ 282us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:20.790488 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:20.790505 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:20.790595 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:20.790725 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 04:55:20.790765 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":113,"threads_started":1}
I20260810 04:55:20.792423 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:20.800311 17025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:20.794300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:57341 (local address 127.0.0.1:36455)
0810 04:55:20.794345 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:20.794347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:20.796241 (+ 1894us) server_negotiation.cc:407] Connection header received
0810 04:55:20.796348 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:20.796349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:20.796363 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:20.796431 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:20.796591 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:20.797423 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:20.798552 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:20.798916 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:20.798990 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:20.799883 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:20.799885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:20.799885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:20.799890 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:20.799911 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:20.799915 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:20.799979 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:20.800171 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 04:55:20.800189 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:55:20.800859 17026 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:20.801421 17026 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:20.813798 17026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08b0afa62c7146448533f7dca45cb900: Generated new TSK 0
I20260810 04:55:20.814069 17026 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:20.816879 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 16898
W20260810 04:55:20.844224 16877 connection.cc:535] client connection to 127.0.0.1:36455 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36455): Connection reset by peer (error 104)
2026-08-10T04:55:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1647 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:20 dist-test-slave-kvfs krb5kdc[17044](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:20 dist-test-slave-kvfs krb5kdc[17044](info): set up 2 sockets
Aug 10 04:55:20 dist-test-slave-kvfs krb5kdc[17044](info): commencing operation
krb5kdc: starting...
W20260810 04:55:22.122232 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:22 dist-test-slave-kvfs krb5kdc[17044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 04:55:22.263536 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40003
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:22.361876 17066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:22.362170 17066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:22.362213 17066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:22.363444 17066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:22.363516 17066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:22.363547 17066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:22.363583 17066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:22.363610 17066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:22.365276 17066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40003
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:22.365594 17066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:22.365876 17066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:22.371652 17071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:22.371661 17075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:22.371661 17073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:22.371949 17066 server_base.cc:1034] running on GCE node
I20260810 04:55:22.372339 17066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:22.372682 17066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:22.373883 17066 hybrid_clock.cc:648] HybridClock initialized: now 1786337722373867 us; error 35 us; skew 500 ppm
Aug 10 04:55:22 dist-test-slave-kvfs krb5kdc[17044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337722, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:22.377228 17066 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 04:55:22.377784 17066 webserver.cc:460] Webserver started at http://127.0.0.1:41421/ using document root <none> and password file <none>
I20260810 04:55:22.378047 17066 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:22.378121 17066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:22.378290 17066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:22.379529 17066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "829b76eb59a04c019b9d32797ec6a6b3"
format_stamp: "Formatted at 2026-08-10 04:55:22 on dist-test-slave-kvfs"
server_key: "9f62cd394f924e5d69b90c474bbfb086"
server_key_iv: "fdfa724d6f26b0fbb08e03ae0dab9e46"
server_key_version: "encryptionkey@0"
I20260810 04:55:22.379951 17066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "829b76eb59a04c019b9d32797ec6a6b3"
format_stamp: "Formatted at 2026-08-10 04:55:22 on dist-test-slave-kvfs"
server_key: "9f62cd394f924e5d69b90c474bbfb086"
server_key_iv: "fdfa724d6f26b0fbb08e03ae0dab9e46"
server_key_version: "encryptionkey@0"
I20260810 04:55:22.381807 17066 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260810 04:55:22.382669 17083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:22.382874 17066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:22.383002 17066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "829b76eb59a04c019b9d32797ec6a6b3"
format_stamp: "Formatted at 2026-08-10 04:55:22 on dist-test-slave-kvfs"
server_key: "9f62cd394f924e5d69b90c474bbfb086"
server_key_iv: "fdfa724d6f26b0fbb08e03ae0dab9e46"
server_key_version: "encryptionkey@0"
I20260810 04:55:22.383087 17066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:22.386834 17066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:22.389155 17066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:22.389330 17066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:22.394438 17066 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40003
I20260810 04:55:22.394481 17169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40003 every 8 connection(s)
I20260810 04:55:22.394896 17066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:22.396152 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:22.398777 17170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3: Bootstrap starting.
I20260810 04:55:22.399490 17170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:22.399819 17170 log.cc:824] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:22.400595 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17066
I20260810 04:55:22.400738 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:22.400945 16319 external_mini_cluster.cc:1428] Setting key b548e71365b864774393266d61959aac
I20260810 04:55:22.400996 17170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3: No bootstrap required, opened a new log
I20260810 04:55:22.403101 17170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "829b76eb59a04c019b9d32797ec6a6b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40003 } }
I20260810 04:55:22.403290 17170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:22.403330 17170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829b76eb59a04c019b9d32797ec6a6b3, State: Initialized, Role: FOLLOWER
I20260810 04:55:22.403522 17170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "829b76eb59a04c019b9d32797ec6a6b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40003 } }
I20260810 04:55:22.403649 17170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:22.403702 17170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:22.403752 17170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:22.404712 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:22.401557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:46973 (local address 127.0.0.1:40003)
0810 04:55:22.401756 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:22.401765 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:22.401794 (+ 29us) server_negotiation.cc:407] Connection header received
0810 04:55:22.403084 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:22.403094 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:22.403130 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:22.403275 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:22.404161 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:22.404166 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:22.404166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:22.404170 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:22.404220 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:22.404233 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:22.404292 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:22.404402 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 04:55:22.404464 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260810 04:55:22.405120 17170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "829b76eb59a04c019b9d32797ec6a6b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40003 } }
I20260810 04:55:22.405243 17170 leader_election.cc:302] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 829b76eb59a04c019b9d32797ec6a6b3; no voters:
I20260810 04:55:22.405423 17170 leader_election.cc:288] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:22.405565 17178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:22.405704 17170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:22.405761 17178 raft_consensus.cc:686] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [term 1 LEADER]: Becoming Leader. State: Replica: 829b76eb59a04c019b9d32797ec6a6b3, State: Running, Role: LEADER
I20260810 04:55:22.405860 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:22.405884 17178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "829b76eb59a04c019b9d32797ec6a6b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40003 } }
I20260810 04:55:22.406322 17179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "829b76eb59a04c019b9d32797ec6a6b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "829b76eb59a04c019b9d32797ec6a6b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40003 } } }
I20260810 04:55:22.406474 17179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:22.406703 17180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 829b76eb59a04c019b9d32797ec6a6b3. Latest consensus state: current_term: 1 leader_uuid: "829b76eb59a04c019b9d32797ec6a6b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "829b76eb59a04c019b9d32797ec6a6b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40003 } } }
I20260810 04:55:22.406785 17180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:22.406930 17182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:22.407612 17182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:22.410027 17182 catalog_manager.cc:1347] Generated new cluster ID: 9d6d8bfa83674154ba9200d5ef159065
I20260810 04:55:22.410094 17182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:22.410171 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:22.408353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.146:43735 (local address 127.0.0.1:40003)
0810 04:55:22.408405 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:22.408408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:22.408824 (+ 416us) server_negotiation.cc:407] Connection header received
0810 04:55:22.408915 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:22.408916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:22.408921 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:22.408975 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:22.409776 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:22.409777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:22.409778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:22.409782 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:22.409798 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:22.409803 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:22.409835 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:22.409988 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 04:55:22.410012 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 04:55:22.440677 17182 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:22.440963 17182 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:22.449256 17182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 829b76eb59a04c019b9d32797ec6a6b3: Generated new TSK 0
I20260810 04:55:22.449532 17182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:22.452050 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17066
2026-08-10T04:55:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1624 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:22 dist-test-slave-kvfs krb5kdc[17206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:22 dist-test-slave-kvfs krb5kdc[17206](info): set up 2 sockets
Aug 10 04:55:22 dist-test-slave-kvfs krb5kdc[17206](info): commencing operation
krb5kdc: starting...
W20260810 04:55:23.736217 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:23 dist-test-slave-kvfs krb5kdc[17206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:23.892410 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35863
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:35863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:23.988902 17226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:23.989228 17226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:23.989269 17226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:23.990530 17226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:23.990613 17226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:23.990638 17226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:23.990657 17226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:23.990689 17226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:23.992338 17226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:35863
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:35863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:23.992681 17226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:23.992964 17226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:23.998802 17235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:23.998773 17232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:23.998788 17233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:23.999095 17226 server_base.cc:1034] running on GCE node
I20260810 04:55:23.999408 17226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:23.999801 17226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:24.001009 17226 hybrid_clock.cc:648] HybridClock initialized: now 1786337724000977 us; error 48 us; skew 500 ppm
Aug 10 04:55:23 dist-test-slave-kvfs krb5kdc[17206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337723, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:24.004130 17226 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:24.004662 17226 webserver.cc:460] Webserver started at http://127.15.239.254:38151/ using document root <none> and password file <none>
I20260810 04:55:24.004920 17226 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:24.005002 17226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:24.005170 17226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:24.006435 17226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "9993e14bb2224d45994807cc11fb473e"
format_stamp: "Formatted at 2026-08-10 04:55:24 on dist-test-slave-kvfs"
server_key: "54c2b280306f34d922f4136f18e87d46"
server_key_iv: "520714d76326160d51d0d9c65c8a6eb1"
server_key_version: "encryptionkey@0"
I20260810 04:55:24.006858 17226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "9993e14bb2224d45994807cc11fb473e"
format_stamp: "Formatted at 2026-08-10 04:55:24 on dist-test-slave-kvfs"
server_key: "54c2b280306f34d922f4136f18e87d46"
server_key_iv: "520714d76326160d51d0d9c65c8a6eb1"
server_key_version: "encryptionkey@0"
I20260810 04:55:24.008513 17226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:55:24.009409 17246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:24.009646 17226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:24.009769 17226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "9993e14bb2224d45994807cc11fb473e"
format_stamp: "Formatted at 2026-08-10 04:55:24 on dist-test-slave-kvfs"
server_key: "54c2b280306f34d922f4136f18e87d46"
server_key_iv: "520714d76326160d51d0d9c65c8a6eb1"
server_key_version: "encryptionkey@0"
I20260810 04:55:24.009853 17226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:24.018815 17226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:24.021387 17226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:24.021589 17226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:24.026894 17226 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:35863
I20260810 04:55:24.026942 17327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:35863 every 8 connection(s)
I20260810 04:55:24.027400 17226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:24.028545 17329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:24.030484 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17226
I20260810 04:55:24.030597 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:24.030840 16319 external_mini_cluster.cc:1428] Setting key 7ee898aa1a451ef308de394532c2576c
I20260810 04:55:24.032106 17329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e: Bootstrap starting.
I20260810 04:55:24.032979 17329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:24.033396 17329 log.cc:824] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:24.034232 17329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e: No bootstrap required, opened a new log
I20260810 04:55:24.036832 17329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } }
I20260810 04:55:24.037060 17329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:24.037107 17329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9993e14bb2224d45994807cc11fb473e, State: Initialized, Role: FOLLOWER
I20260810 04:55:24.037348 17329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } }
I20260810 04:55:24.037546 17339 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:55:24.037678 17339 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } }
I20260810 04:55:24.037516 17329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:24.037809 17339 leader_election.cc:302] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9993e14bb2224d45994807cc11fb473e; no voters:
I20260810 04:55:24.037853 17329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:24.037943 17329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:24.038064 17339 leader_election.cc:288] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260810 04:55:24.038764 17329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } }
I20260810 04:55:24.038864 17329 leader_election.cc:302] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9993e14bb2224d45994807cc11fb473e; no voters:
I20260810 04:55:24.038897 17341 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 04:55:24.038990 17329 leader_election.cc:288] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:24.039067 17341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:24.039136 17341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [term 1 LEADER]: Becoming Leader. State: Replica: 9993e14bb2224d45994807cc11fb473e, State: Running, Role: LEADER
I20260810 04:55:24.039258 17341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } }
I20260810 04:55:24.039361 17329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 04:55:24 dist-test-slave-kvfs krb5kdc[17206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:24.039683 17341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9993e14bb2224d45994807cc11fb473e. Latest consensus state: current_term: 1 leader_uuid: "9993e14bb2224d45994807cc11fb473e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } } }
I20260810 04:55:24.039691 17342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9993e14bb2224d45994807cc11fb473e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9993e14bb2224d45994807cc11fb473e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 35863 } } }
I20260810 04:55:24.039813 17341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:24.039851 17342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:24.040156 17349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:24.040874 17349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:24.042696 17349 catalog_manager.cc:1347] Generated new cluster ID: 6489aa40e449486c95d51635db46c60d
I20260810 04:55:24.042753 17349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:24.044909 17335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:24.031569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53989 (local address 127.15.239.254:35863)
0810 04:55:24.031758 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:24.031768 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:24.031799 (+ 31us) server_negotiation.cc:407] Connection header received
0810 04:55:24.032384 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:24.032394 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:24.032453 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:24.032594 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:24.033626 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:24.034852 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:24.036139 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:24.036646 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:24.036749 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:24.040472 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:24.040477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:24.040478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:24.040494 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:24.042991 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:24.043459 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:24.043463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:24.043464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:24.043573 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:24.043834 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:24.043835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:24.043836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:24.044206 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:24.044420 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:24.044520 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 04:55:24.044638 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260810 04:55:24.046155 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:24.050410 17349 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:24.051146 17349 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:24.055552 17335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:24.047950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35301 (local address 127.15.239.254:35863)
0810 04:55:24.047994 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:24.047997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:24.048191 (+ 194us) server_negotiation.cc:407] Connection header received
0810 04:55:24.048275 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:24.048276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:24.048288 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:24.048350 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:24.048958 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:24.049539 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:24.050718 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:24.050983 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:24.051080 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:24.052552 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:24.052554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:24.052554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:24.052563 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:24.054182 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:24.054609 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:24.054611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:24.054611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:24.054678 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:24.054937 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:24.054939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:24.054939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:24.055066 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:24.055228 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:24.055355 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 04:55:24.055428 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:55:24.066365 17349 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9993e14bb2224d45994807cc11fb473e: Generated new TSK 0
I20260810 04:55:24.066612 17349 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:24.070890 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17226
W20260810 04:55:24.093997 17204 connection.cc:535] client connection to 127.15.239.254:35863 recv error: Network error: failed to read from TLS socket (remote: 127.15.239.254:35863): Connection reset by peer (error 104)
2026-08-10T04:55:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1624 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:24 dist-test-slave-kvfs krb5kdc[17377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:24 dist-test-slave-kvfs krb5kdc[17377](info): set up 2 sockets
Aug 10 04:55:24 dist-test-slave-kvfs krb5kdc[17377](info): commencing operation
krb5kdc: starting...
W20260810 04:55:25.438884 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.329s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:25 dist-test-slave-kvfs krb5kdc[17377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:25.588541 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:33473
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:33969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:33473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:25.686405 17394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:25.686697 17394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:25.686735 17394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:25.687958 17394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:25.688030 17394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:25.688072 17394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:25.688103 17394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:25.688154 17394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:25.689750 17394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:33473
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:33473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:25.690074 17394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:25.690338 17394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:25.696125 17406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:25.696105 17404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:25.696171 17402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:25.696532 17394 server_base.cc:1034] running on GCE node
I20260810 04:55:25.696879 17394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:25.697216 17394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:25.698405 17394 hybrid_clock.cc:648] HybridClock initialized: now 1786337725698387 us; error 47 us; skew 500 ppm
Aug 10 04:55:25 dist-test-slave-kvfs krb5kdc[17377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337725, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:25.701575 17394 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:25.702153 17394 webserver.cc:460] Webserver started at http://127.15.239.254:44205/ using document root <none> and password file <none>
I20260810 04:55:25.702431 17394 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:25.702507 17394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:25.702680 17394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:25.703986 17394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "e42a6964ae654afeb768c266a9b024b7"
format_stamp: "Formatted at 2026-08-10 04:55:25 on dist-test-slave-kvfs"
server_key: "340a6abf66e5d7d304c71cd18e363a94"
server_key_iv: "4279b06543e91ed649624506376cf8c5"
server_key_version: "encryptionkey@0"
I20260810 04:55:25.704495 17394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "e42a6964ae654afeb768c266a9b024b7"
format_stamp: "Formatted at 2026-08-10 04:55:25 on dist-test-slave-kvfs"
server_key: "340a6abf66e5d7d304c71cd18e363a94"
server_key_iv: "4279b06543e91ed649624506376cf8c5"
server_key_version: "encryptionkey@0"
I20260810 04:55:25.706123 17394 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:25.707098 17417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:25.707371 17394 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:25.707515 17394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "e42a6964ae654afeb768c266a9b024b7"
format_stamp: "Formatted at 2026-08-10 04:55:25 on dist-test-slave-kvfs"
server_key: "340a6abf66e5d7d304c71cd18e363a94"
server_key_iv: "4279b06543e91ed649624506376cf8c5"
server_key_version: "encryptionkey@0"
I20260810 04:55:25.707605 17394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:25.728245 17394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:25.730980 17394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:25.731174 17394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:25.736580 17394 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:33473
I20260810 04:55:25.736671 17498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:33473 every 8 connection(s)
I20260810 04:55:25.737135 17394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:25.738252 17499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:25.741217 17499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7: Bootstrap starting.
I20260810 04:55:25.741957 17499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:25.742309 17499 log.cc:824] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:25.743163 17499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7: No bootstrap required, opened a new log
I20260810 04:55:25.745033 17499 raft_consensus.cc:348] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a6964ae654afeb768c266a9b024b7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 33473 } }
I20260810 04:55:25.745208 17499 raft_consensus.cc:374] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:25.745234 17499 raft_consensus.cc:729] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42a6964ae654afeb768c266a9b024b7, State: Initialized, Role: FOLLOWER
I20260810 04:55:25.745417 17499 consensus_queue.cc:260] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a6964ae654afeb768c266a9b024b7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 33473 } }
I20260810 04:55:25.745510 17499 raft_consensus.cc:388] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:25.745535 17499 raft_consensus.cc:482] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:25.745592 17499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:25.746645 17499 raft_consensus.cc:504] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a6964ae654afeb768c266a9b024b7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 33473 } }
I20260810 04:55:25.746685 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17394
I20260810 04:55:25.746762 17499 leader_election.cc:302] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e42a6964ae654afeb768c266a9b024b7; no voters:
I20260810 04:55:25.746838 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:25.747021 17499 leader_election.cc:288] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:25.747087 17502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:25.747123 16319 external_mini_cluster.cc:1428] Setting key 1e2040954ccffdf92eed36fba41c10be
I20260810 04:55:25.747318 17502 raft_consensus.cc:686] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [term 1 LEADER]: Becoming Leader. State: Replica: e42a6964ae654afeb768c266a9b024b7, State: Running, Role: LEADER
I20260810 04:55:25.747394 17499 sys_catalog.cc:564] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:25.747519 17502 consensus_queue.cc:237] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a6964ae654afeb768c266a9b024b7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 33473 } }
I20260810 04:55:25.748140 17504 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e42a6964ae654afeb768c266a9b024b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a6964ae654afeb768c266a9b024b7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 33473 } } }
I20260810 04:55:25.748251 17504 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:25.748726 17505 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e42a6964ae654afeb768c266a9b024b7. Latest consensus state: current_term: 1 leader_uuid: "e42a6964ae654afeb768c266a9b024b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a6964ae654afeb768c266a9b024b7" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 33473 } } }
I20260810 04:55:25.748910 17505 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7 [sys.catalog]: This master's current role is: LEADER
W20260810 04:55:25.749725 17530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:25.749786 17530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:25.749835 17520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:25.750002 17520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:25.751713 17520 catalog_manager.cc:1347] Generated new cluster ID: 16d4f13a1c6d4daaba8690e8b00998c6
I20260810 04:55:25.751770 17520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:25.754264 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:25.747883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46563 (local address 127.15.239.254:33473)
0810 04:55:25.748159 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:25.748171 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:25.748210 (+ 39us) server_negotiation.cc:407] Connection header received
0810 04:55:25.748360 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:25.748369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:25.748438 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:25.748924 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:25.749052 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:25.750594 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:25.751780 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:25.752427 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:25.752540 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:25.753445 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:25.753449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:25.753449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:25.753697 (+ 248us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:25.753743 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:25.753758 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:25.753841 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:25.753993 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 04:55:25.754025 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":105,"threads_started":1}
I20260810 04:55:25.755404 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:25.761132 17508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:25.757337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50525 (local address 127.15.239.254:33473)
0810 04:55:25.757385 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:25.757387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:25.757533 (+ 146us) server_negotiation.cc:407] Connection header received
0810 04:55:25.757563 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:25.757564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:25.757591 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:25.757652 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:25.757789 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:25.758579 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:25.759600 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:25.759956 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:25.760054 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:25.760846 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:25.760848 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:25.760849 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:25.760855 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:25.760874 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:25.760879 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:25.760959 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:25.761023 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 04:55:25.761037 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:55:25.763849 17520 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:25.764447 17520 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:25.766863 17520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e42a6964ae654afeb768c266a9b024b7: Generated new TSK 0
I20260810 04:55:25.767105 17520 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:25.773618 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17394
W20260810 04:55:25.791126 17374 connection.cc:535] client connection to 127.15.239.254:33473 recv error: Network error: failed to read from TLS socket (remote: 127.15.239.254:33473): Connection reset by peer (error 104)
2026-08-10T04:55:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1696 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:25 dist-test-slave-kvfs krb5kdc[17544](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:25 dist-test-slave-kvfs krb5kdc[17544](info): set up 2 sockets
Aug 10 04:55:25 dist-test-slave-kvfs krb5kdc[17544](info): commencing operation
krb5kdc: starting...
W20260810 04:55:27.077307 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:27 dist-test-slave-kvfs krb5kdc[17544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:27.217131 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42371
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:39779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:42371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:27.318454 17565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:27.318720 17565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:27.318748 17565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:27.319933 17565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:27.319976 17565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:27.319991 17565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:27.320003 17565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:27.320065 17565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:27.321641 17565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:39779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:42371
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:42371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:27.321880 17565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:27.322100 17565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:55:27.328063 17565 server_base.cc:1034] running on GCE node
W20260810 04:55:27.328022 17576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:27.328014 17575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:27.328115 17578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:27.328688 17565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:27.329013 17565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:27.330175 17565 hybrid_clock.cc:648] HybridClock initialized: now 1786337727330161 us; error 34 us; skew 500 ppm
Aug 10 04:55:27 dist-test-slave-kvfs krb5kdc[17544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337727, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:27.333426 17565 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:27.333978 17565 webserver.cc:460] Webserver started at http://127.15.239.254:40369/ using document root <none> and password file <none>
I20260810 04:55:27.334249 17565 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:27.334324 17565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:27.334503 17565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:27.335857 17565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "66393855244b4794a3d5bebc8b004a5e"
format_stamp: "Formatted at 2026-08-10 04:55:27 on dist-test-slave-kvfs"
server_key: "ad7bd5509900d913650b2d14216e7c88"
server_key_iv: "0ac977dba713f716c15156f8df16f761"
server_key_version: "encryptionkey@0"
I20260810 04:55:27.336328 17565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "66393855244b4794a3d5bebc8b004a5e"
format_stamp: "Formatted at 2026-08-10 04:55:27 on dist-test-slave-kvfs"
server_key: "ad7bd5509900d913650b2d14216e7c88"
server_key_iv: "0ac977dba713f716c15156f8df16f761"
server_key_version: "encryptionkey@0"
I20260810 04:55:27.337875 17565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:55:27.338861 17589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:27.339114 17565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:27.339248 17565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "66393855244b4794a3d5bebc8b004a5e"
format_stamp: "Formatted at 2026-08-10 04:55:27 on dist-test-slave-kvfs"
server_key: "ad7bd5509900d913650b2d14216e7c88"
server_key_iv: "0ac977dba713f716c15156f8df16f761"
server_key_version: "encryptionkey@0"
I20260810 04:55:27.339336 17565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:27.343585 17565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:27.346117 17565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:27.346242 17565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:27.351316 17565 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:42371
I20260810 04:55:27.351408 17673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:42371 every 8 connection(s)
I20260810 04:55:27.351781 17565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:27.353103 17674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:27.353909 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17565
I20260810 04:55:27.354043 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:27.354270 16319 external_mini_cluster.cc:1428] Setting key 8751ff7ab32af3394f21073e0b4456a2
I20260810 04:55:27.356928 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e: Bootstrap starting.
I20260810 04:55:27.357445 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:27.354983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34775 (local address 127.15.239.254:42371)
0810 04:55:27.355210 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:27.355221 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:27.355262 (+ 41us) server_negotiation.cc:407] Connection header received
0810 04:55:27.355910 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:27.355921 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:27.355964 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:27.356166 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:27.356912 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:27.356917 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:27.356917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:27.356922 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:27.356975 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:27.356990 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:27.357069 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:27.357150 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 04:55:27.357196 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":101,"threads_started":1}
I20260810 04:55:27.357856 17674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:27.358240 17674 log.cc:824] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:27.358680 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:27.359112 17674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e: No bootstrap required, opened a new log
I20260810 04:55:27.361838 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:27.360645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55631 (local address 127.15.239.254:42371)
0810 04:55:27.360711 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:27.360714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:27.360851 (+ 137us) server_negotiation.cc:407] Connection header received
0810 04:55:27.360927 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:27.360928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:27.360943 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:27.361000 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:27.361604 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:27.361605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:27.361605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:27.361609 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:27.361625 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:27.361628 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:27.361673 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:27.361735 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 04:55:27.361747 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:55:27.362112 17674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66393855244b4794a3d5bebc8b004a5e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42371 } }
I20260810 04:55:27.362308 17674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:27.362335 17674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66393855244b4794a3d5bebc8b004a5e, State: Initialized, Role: FOLLOWER
I20260810 04:55:27.362504 17674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66393855244b4794a3d5bebc8b004a5e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42371 } }
I20260810 04:55:27.362622 17674 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:27.362661 17674 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:27.362701 17674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:27.363271 17674 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66393855244b4794a3d5bebc8b004a5e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42371 } }
I20260810 04:55:27.363377 17674 leader_election.cc:302] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66393855244b4794a3d5bebc8b004a5e; no voters:
I20260810 04:55:27.363541 17674 leader_election.cc:288] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:27.363616 17688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:27.363806 17688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [term 1 LEADER]: Becoming Leader. State: Replica: 66393855244b4794a3d5bebc8b004a5e, State: Running, Role: LEADER
I20260810 04:55:27.363842 17674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:27.363912 17688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66393855244b4794a3d5bebc8b004a5e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42371 } }
I20260810 04:55:27.364365 17689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66393855244b4794a3d5bebc8b004a5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66393855244b4794a3d5bebc8b004a5e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42371 } } }
I20260810 04:55:27.364372 17691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66393855244b4794a3d5bebc8b004a5e. Latest consensus state: current_term: 1 leader_uuid: "66393855244b4794a3d5bebc8b004a5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66393855244b4794a3d5bebc8b004a5e" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 42371 } } }
I20260810 04:55:27.364661 17689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:27.364665 17691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:27.364954 17701 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:27.365566 17701 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:27.367414 17701 catalog_manager.cc:1347] Generated new cluster ID: cc40bcddeae24ec189e66a7245a6493d
I20260810 04:55:27.367483 17701 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:27.372103 17701 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:27.372345 17701 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:27.378433 17701 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66393855244b4794a3d5bebc8b004a5e: Generated new TSK 0
I20260810 04:55:27.378639 17701 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:27.386659 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17565
2026-08-10T04:55:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:27 dist-test-slave-kvfs krb5kdc[17720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:27 dist-test-slave-kvfs krb5kdc[17720](info): set up 2 sockets
Aug 10 04:55:27 dist-test-slave-kvfs krb5kdc[17720](info): commencing operation
krb5kdc: starting...
W20260810 04:55:28.696938 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:28 dist-test-slave-kvfs krb5kdc[17720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:28.844751 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:45365
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:43897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:45365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:28.945817 17738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:28.946134 17738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:28.946179 17738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:28.947463 17738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:28.947561 17738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:28.947587 17738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:28.947607 17738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:28.947640 17738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:28.949379 17738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:43897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:45365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:45365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:28.949725 17738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:28.950013 17738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:28.955789 17753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:28.955812 17747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:28.955814 17750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:28.956125 17738 server_base.cc:1034] running on GCE node
I20260810 04:55:28.956444 17738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:28.956789 17738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:28.957988 17738 hybrid_clock.cc:648] HybridClock initialized: now 1786337728957961 us; error 41 us; skew 500 ppm
Aug 10 04:55:28 dist-test-slave-kvfs krb5kdc[17720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337728, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:28.961083 17738 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:28.961669 17738 webserver.cc:460] Webserver started at http://127.15.239.254:38477/ using document root <none> and password file <none>
I20260810 04:55:28.961969 17738 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:28.962045 17738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:28.962213 17738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:28.963452 17738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "bccdc12d347b43438403b399a054ee92"
format_stamp: "Formatted at 2026-08-10 04:55:28 on dist-test-slave-kvfs"
server_key: "6e92f6e3b80899216c22bd652cbb8209"
server_key_iv: "1688b18abc9746cb29bfe47042b34526"
server_key_version: "encryptionkey@0"
I20260810 04:55:28.963876 17738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "bccdc12d347b43438403b399a054ee92"
format_stamp: "Formatted at 2026-08-10 04:55:28 on dist-test-slave-kvfs"
server_key: "6e92f6e3b80899216c22bd652cbb8209"
server_key_iv: "1688b18abc9746cb29bfe47042b34526"
server_key_version: "encryptionkey@0"
I20260810 04:55:28.965555 17738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:55:28.966516 17765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:28.966732 17738 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:28.966903 17738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "bccdc12d347b43438403b399a054ee92"
format_stamp: "Formatted at 2026-08-10 04:55:28 on dist-test-slave-kvfs"
server_key: "6e92f6e3b80899216c22bd652cbb8209"
server_key_iv: "1688b18abc9746cb29bfe47042b34526"
server_key_version: "encryptionkey@0"
I20260810 04:55:28.967000 17738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:28.979215 17738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:28.981703 17738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:28.981912 17738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:28.987483 17738 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:45365
I20260810 04:55:28.987540 17842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:45365 every 8 connection(s)
I20260810 04:55:28.988046 17738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:28.989289 17843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:28.992226 17843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92: Bootstrap starting.
I20260810 04:55:28.992707 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17738
I20260810 04:55:28.992841 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:28.993067 17843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:28.993072 16319 external_mini_cluster.cc:1428] Setting key 44b8dcc99222b30b4608974f0691a823
I20260810 04:55:28.993422 17843 log.cc:824] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:28.994331 17843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92: No bootstrap required, opened a new log
I20260810 04:55:28.996938 17843 raft_consensus.cc:348] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bccdc12d347b43438403b399a054ee92" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45365 } }
I20260810 04:55:28.997148 17843 raft_consensus.cc:374] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:28.997187 17843 raft_consensus.cc:729] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bccdc12d347b43438403b399a054ee92, State: Initialized, Role: FOLLOWER
I20260810 04:55:28.997344 17843 consensus_queue.cc:260] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bccdc12d347b43438403b399a054ee92" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45365 } }
I20260810 04:55:28.997438 17843 raft_consensus.cc:388] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:28.997471 17843 raft_consensus.cc:482] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:28.997514 17843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:28.998261 17843 raft_consensus.cc:504] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bccdc12d347b43438403b399a054ee92" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45365 } }
I20260810 04:55:28.998418 17843 leader_election.cc:302] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bccdc12d347b43438403b399a054ee92; no voters:
I20260810 04:55:28.998641 17843 leader_election.cc:288] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:28.998687 17848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:28.998894 17848 raft_consensus.cc:686] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [term 1 LEADER]: Becoming Leader. State: Replica: bccdc12d347b43438403b399a054ee92, State: Running, Role: LEADER
I20260810 04:55:28.999022 17843 sys_catalog.cc:564] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:28.999039 17848 consensus_queue.cc:237] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bccdc12d347b43438403b399a054ee92" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45365 } }
I20260810 04:55:28.999557 17848 sys_catalog.cc:455] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bccdc12d347b43438403b399a054ee92. Latest consensus state: current_term: 1 leader_uuid: "bccdc12d347b43438403b399a054ee92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bccdc12d347b43438403b399a054ee92" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45365 } } }
I20260810 04:55:28.999564 17851 sys_catalog.cc:455] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bccdc12d347b43438403b399a054ee92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bccdc12d347b43438403b399a054ee92" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 45365 } } }
I20260810 04:55:28.999647 17848 sys_catalog.cc:458] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:28.999676 17851 sys_catalog.cc:458] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:28.999970 17855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:29.000689 17855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 04:55:28 dist-test-slave-kvfs krb5kdc[17720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:29.003216 17855 catalog_manager.cc:1347] Generated new cluster ID: 0b02b4e55dbd43909192ecbda0796526
I20260810 04:55:29.003268 17855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:29.006733 17847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:28.993766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46479 (local address 127.15.239.254:45365)
0810 04:55:28.993969 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:28.993982 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:28.994022 (+ 40us) server_negotiation.cc:407] Connection header received
0810 04:55:28.994598 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:28.994607 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:28.994664 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:28.994810 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:28.995711 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:28.996785 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:28.997945 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:28.998480 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:28.998649 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:29.001979 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:29.001984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:29.001985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:29.001998 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:29.004874 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:29.005278 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:29.005322 (+ 44us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:29.005323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:29.005438 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:29.005707 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:29.005709 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:29.005710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:29.006010 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:29.006202 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:29.006308 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 04:55:29.006462 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260810 04:55:29.007893 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:29.016170 17847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:29.009588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48817 (local address 127.15.239.254:45365)
0810 04:55:29.009632 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:29.009634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:29.009739 (+ 105us) server_negotiation.cc:407] Connection header received
0810 04:55:29.009802 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:29.009803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:29.009813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:29.009859 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:29.010445 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:29.010987 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:29.011744 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:29.011984 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:29.012083 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:29.013366 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:29.013367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:29.013368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:29.013376 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:29.014896 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:29.015282 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:29.015283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:29.015284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:29.015343 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:29.015562 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:29.015563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:29.015563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:29.015684 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:29.015798 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:29.015900 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 04:55:29.016000 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:55:29.042340 17855 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:29.043092 17855 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:29.052452 17855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bccdc12d347b43438403b399a054ee92: Generated new TSK 0
I20260810 04:55:29.052712 17855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:29.055487 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17738
2026-08-10T04:55:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1665 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:29 dist-test-slave-kvfs krb5kdc[17882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:29 dist-test-slave-kvfs krb5kdc[17882](info): set up 2 sockets
Aug 10 04:55:29 dist-test-slave-kvfs krb5kdc[17882](info): commencing operation
krb5kdc: starting...
W20260810 04:55:30.363920 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:30 dist-test-slave-kvfs krb5kdc[17882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:30.511637 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41645
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:41645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:30.613751 17914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:30.614099 17914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:30.614142 17914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:30.615428 17914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:30.615512 17914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:30.615538 17914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:30.615561 17914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:30.615589 17914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:30.617298 17914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:41645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:41645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:30.617654 17914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:30.617946 17914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:30.623836 17924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:30.623899 17923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:30.623914 17927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:30.624111 17914 server_base.cc:1034] running on GCE node
I20260810 04:55:30.624508 17914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:30.624866 17914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:30.626017 17914 hybrid_clock.cc:648] HybridClock initialized: now 1786337730626010 us; error 40 us; skew 500 ppm
Aug 10 04:55:30 dist-test-slave-kvfs krb5kdc[17882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337730, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:30.634588 17914 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:30.635284 17914 webserver.cc:460] Webserver started at http://127.15.239.254:45831/ using document root <none> and password file <none>
I20260810 04:55:30.635615 17914 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:30.635675 17914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:30.635855 17914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:30.637344 17914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "c39a7a7e7042479885a6fc218989a912"
format_stamp: "Formatted at 2026-08-10 04:55:30 on dist-test-slave-kvfs"
server_key: "1b5bbc78e05ff4d30198f57e6dac62e0"
server_key_iv: "a16aea98dda7701c10710659ac07404b"
server_key_version: "encryptionkey@0"
I20260810 04:55:30.637810 17914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "c39a7a7e7042479885a6fc218989a912"
format_stamp: "Formatted at 2026-08-10 04:55:30 on dist-test-slave-kvfs"
server_key: "1b5bbc78e05ff4d30198f57e6dac62e0"
server_key_iv: "a16aea98dda7701c10710659ac07404b"
server_key_version: "encryptionkey@0"
I20260810 04:55:30.639657 17914 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 04:55:30.640867 17938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:30.641227 17914 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:30.641369 17914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "c39a7a7e7042479885a6fc218989a912"
format_stamp: "Formatted at 2026-08-10 04:55:30 on dist-test-slave-kvfs"
server_key: "1b5bbc78e05ff4d30198f57e6dac62e0"
server_key_iv: "a16aea98dda7701c10710659ac07404b"
server_key_version: "encryptionkey@0"
I20260810 04:55:30.641461 17914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:30.654314 17914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:30.656934 17914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:30.657131 17914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:30.662390 17914 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:41645
I20260810 04:55:30.662431 18034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:41645 every 8 connection(s)
I20260810 04:55:30.662865 17914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:30.663987 18035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:30.666785 18035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912: Bootstrap starting.
I20260810 04:55:30.667534 18035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:30.667888 18035 log.cc:824] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:30.668725 18035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912: No bootstrap required, opened a new log
I20260810 04:55:30.670156 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 17914
I20260810 04:55:30.670289 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:30.670517 16319 external_mini_cluster.cc:1428] Setting key 31719652ca75def92bb2df54478648ca
I20260810 04:55:30.670964 18035 raft_consensus.cc:348] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39a7a7e7042479885a6fc218989a912" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41645 } }
I20260810 04:55:30.671232 18035 raft_consensus.cc:374] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:30.671303 18035 raft_consensus.cc:729] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c39a7a7e7042479885a6fc218989a912, State: Initialized, Role: FOLLOWER
I20260810 04:55:30.671526 18035 consensus_queue.cc:260] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39a7a7e7042479885a6fc218989a912" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41645 } }
I20260810 04:55:30.671613 18035 raft_consensus.cc:388] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:30.671638 18035 raft_consensus.cc:482] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:30.671712 18035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:30.672528 18035 raft_consensus.cc:504] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39a7a7e7042479885a6fc218989a912" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41645 } }
I20260810 04:55:30.672655 18035 leader_election.cc:302] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c39a7a7e7042479885a6fc218989a912; no voters:
I20260810 04:55:30.672873 18035 leader_election.cc:288] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:30.672915 18045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:30.673087 18045 raft_consensus.cc:686] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [term 1 LEADER]: Becoming Leader. State: Replica: c39a7a7e7042479885a6fc218989a912, State: Running, Role: LEADER
I20260810 04:55:30.673208 18035 sys_catalog.cc:564] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:30.673231 18045 consensus_queue.cc:237] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39a7a7e7042479885a6fc218989a912" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41645 } }
I20260810 04:55:30.673643 18045 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c39a7a7e7042479885a6fc218989a912. Latest consensus state: current_term: 1 leader_uuid: "c39a7a7e7042479885a6fc218989a912" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39a7a7e7042479885a6fc218989a912" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41645 } } }
I20260810 04:55:30.673728 18047 sys_catalog.cc:455] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c39a7a7e7042479885a6fc218989a912" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c39a7a7e7042479885a6fc218989a912" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 41645 } } }
I20260810 04:55:30.673902 18047 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:30.673806 18045 sys_catalog.cc:458] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:30.674204 18062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:30.674886 18062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:30.677124 18062 catalog_manager.cc:1347] Generated new cluster ID: 54ef684e446049c48d01993d91be6459
I20260810 04:55:30.677212 18062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:30.677400 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:30.671186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48301 (local address 127.15.239.254:41645)
0810 04:55:30.671434 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:30.671444 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:30.671486 (+ 42us) server_negotiation.cc:407] Connection header received
0810 04:55:30.671677 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:30.671686 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:30.671768 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:30.671920 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:30.672357 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:30.673743 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:30.675047 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:30.675513 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:30.675640 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:30.676511 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:30.676517 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:30.676518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:30.676773 (+ 255us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:30.676818 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:30.676835 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:30.676912 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:30.677012 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 04:55:30.677092 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":128,"threads_started":1}
I20260810 04:55:30.678365 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:30.687928 18043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:30.680341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49063 (local address 127.15.239.254:41645)
0810 04:55:30.680397 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:30.680398 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:30.684244 (+ 3846us) server_negotiation.cc:407] Connection header received
0810 04:55:30.684315 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:30.684316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:30.684329 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:30.684380 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:30.684551 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:30.685321 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:30.686410 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:30.686720 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:30.686782 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:30.687635 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:30.687637 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:30.687637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:30.687642 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:30.687662 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:30.687667 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:30.687721 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:30.687802 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 04:55:30.687830 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 04:55:30.689354 18062 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:30.690161 18062 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:30.701385 18062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c39a7a7e7042479885a6fc218989a912: Generated new TSK 0
I20260810 04:55:30.701700 18062 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:30.704742 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 17914
2026-08-10T04:55:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1658 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:30 dist-test-slave-kvfs krb5kdc[18092](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:30 dist-test-slave-kvfs krb5kdc[18092](info): set up 2 sockets
Aug 10 04:55:30 dist-test-slave-kvfs krb5kdc[18092](info): commencing operation
krb5kdc: starting...
W20260810 04:55:32.012161 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:32 dist-test-slave-kvfs krb5kdc[18092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:32.159427 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39799
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:33975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:39799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:32.260809 18110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:32.261103 18110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:32.261143 18110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:32.262348 18110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:32.262420 18110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:32.262445 18110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:32.262467 18110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:32.262496 18110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:32.264127 18110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:33975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:39799
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:39799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:32.264441 18110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:32.264707 18110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:32.270532 18123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:32.270503 18131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:32.270489 18129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:32.271006 18110 server_base.cc:1034] running on GCE node
I20260810 04:55:32.271400 18110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:32.271765 18110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:32.272979 18110 hybrid_clock.cc:648] HybridClock initialized: now 1786337732272948 us; error 61 us; skew 500 ppm
Aug 10 04:55:32 dist-test-slave-kvfs krb5kdc[18092](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337732, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:32.276124 18110 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:32.276697 18110 webserver.cc:460] Webserver started at http://127.15.239.254:46621/ using document root <none> and password file <none>
I20260810 04:55:32.276968 18110 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:32.277045 18110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:32.277215 18110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:32.278458 18110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "21c15c083e464aa48a52dca1b347b96b"
format_stamp: "Formatted at 2026-08-10 04:55:32 on dist-test-slave-kvfs"
server_key: "229e9af4cd837dade19960636834bc5f"
server_key_iv: "cf400e4dc16ff3eca8d9a0a47371c8d6"
server_key_version: "encryptionkey@0"
I20260810 04:55:32.278887 18110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "21c15c083e464aa48a52dca1b347b96b"
format_stamp: "Formatted at 2026-08-10 04:55:32 on dist-test-slave-kvfs"
server_key: "229e9af4cd837dade19960636834bc5f"
server_key_iv: "cf400e4dc16ff3eca8d9a0a47371c8d6"
server_key_version: "encryptionkey@0"
I20260810 04:55:32.280568 18110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 04:55:32.281505 18140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:32.281713 18110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:32.281840 18110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "21c15c083e464aa48a52dca1b347b96b"
format_stamp: "Formatted at 2026-08-10 04:55:32 on dist-test-slave-kvfs"
server_key: "229e9af4cd837dade19960636834bc5f"
server_key_iv: "cf400e4dc16ff3eca8d9a0a47371c8d6"
server_key_version: "encryptionkey@0"
I20260810 04:55:32.281925 18110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:32.285812 18110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:32.288739 18110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:32.288930 18110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:32.294095 18110 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:39799
I20260810 04:55:32.294142 18227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:39799 every 8 connection(s)
I20260810 04:55:32.294592 18110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:32.295835 18228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:32.297272 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18110
I20260810 04:55:32.297410 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:32.297655 16319 external_mini_cluster.cc:1428] Setting key 08b4b0dee7a95787cbb34a49421e9675
I20260810 04:55:32.299316 18228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b: Bootstrap starting.
I20260810 04:55:32.300257 18228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:32.300649 18228 log.cc:824] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:32.301234 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:32.298432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37113 (local address 127.15.239.254:39799)
0810 04:55:32.298653 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:32.298664 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:32.298696 (+ 32us) server_negotiation.cc:407] Connection header received
0810 04:55:32.299232 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:32.299241 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:32.299274 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:32.299493 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:32.300476 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:32.300482 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:32.300483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:32.300488 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:32.300550 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:32.300564 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:32.300651 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:32.300883 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 04:55:32.300969 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
I20260810 04:55:32.301620 18228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b: No bootstrap required, opened a new log
I20260810 04:55:32.302618 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:32.304877 18228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21c15c083e464aa48a52dca1b347b96b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39799 } }
I20260810 04:55:32.305109 18228 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:55:32.305162 18228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c15c083e464aa48a52dca1b347b96b, State: Initialized, Role: FOLLOWER
I20260810 04:55:32.305305 18228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21c15c083e464aa48a52dca1b347b96b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39799 } }
I20260810 04:55:32.305450 18228 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:55:32.305500 18228 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:55:32.305564 18228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:32.305877 18232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:32.304598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53989 (local address 127.15.239.254:39799)
0810 04:55:32.304654 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:32.304655 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:32.304736 (+ 81us) server_negotiation.cc:407] Connection header received
0810 04:55:32.304791 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:32.304792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:32.304796 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:32.304839 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:32.305564 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:32.305565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:32.305566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 04:55:32.305573 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:32.305593 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 04:55:32.305597 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:32.305671 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:32.305771 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 04:55:32.305787 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:55:32.306360 18228 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21c15c083e464aa48a52dca1b347b96b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39799 } }
I20260810 04:55:32.306504 18228 leader_election.cc:302] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21c15c083e464aa48a52dca1b347b96b; no voters:
I20260810 04:55:32.306702 18228 leader_election.cc:288] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:55:32.306728 18244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:32.306887 18244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [term 1 LEADER]: Becoming Leader. State: Replica: 21c15c083e464aa48a52dca1b347b96b, State: Running, Role: LEADER
I20260810 04:55:32.307025 18228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:32.306988 18244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21c15c083e464aa48a52dca1b347b96b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39799 } }
I20260810 04:55:32.307431 18248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21c15c083e464aa48a52dca1b347b96b. Latest consensus state: current_term: 1 leader_uuid: "21c15c083e464aa48a52dca1b347b96b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21c15c083e464aa48a52dca1b347b96b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39799 } } }
I20260810 04:55:32.307574 18248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:32.307452 18247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21c15c083e464aa48a52dca1b347b96b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21c15c083e464aa48a52dca1b347b96b" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 39799 } } }
I20260810 04:55:32.307732 18247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b [sys.catalog]: This master's current role is: LEADER
W20260810 04:55:32.309044 18271 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:32.309114 18271 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:32.309163 18254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:32.309330 18254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:32.310937 18254 catalog_manager.cc:1347] Generated new cluster ID: ab72046df6ec49f8b39e222a47034d08
I20260810 04:55:32.310997 18254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:32.319890 18254 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:32.320137 18254 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:32.323599 18254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21c15c083e464aa48a52dca1b347b96b: Generated new TSK 0
I20260810 04:55:32.323828 18254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:55:32.328920 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18110
2026-08-10T04:55:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1610 ms)
[----------] 18 tests from AuthTokenIssuingTest (29731 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:32 dist-test-slave-kvfs krb5kdc[18278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:32 dist-test-slave-kvfs krb5kdc[18278](info): set up 2 sockets
Aug 10 04:55:32 dist-test-slave-kvfs krb5kdc[18278](info): commencing operation
krb5kdc: starting...
W20260810 04:55:33.616478 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:33 dist-test-slave-kvfs krb5kdc[18278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:33.763828 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:40361
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:40361,127.15.239.253:45569,127.15.239.252:36725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:33.863722 18295 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:55:33.864084 18295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:33.864132 18295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:33.864172 18295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:33.865511 18295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:33.865589 18295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:33.865613 18295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:33.865633 18295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:33.865661 18295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:33.867336 18295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:40361,127.15.239.253:45569,127.15.239.252:36725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:40361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:33.867695 18295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:33.867980 18295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:33.874122 18305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:33.874104 18310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:33.874107 18306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:33.874352 18295 server_base.cc:1034] running on GCE node
I20260810 04:55:33.874684 18295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:33.875065 18295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:33.876240 18295 hybrid_clock.cc:648] HybridClock initialized: now 1786337733876223 us; error 52 us; skew 500 ppm
Aug 10 04:55:33 dist-test-slave-kvfs krb5kdc[18278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:33.879258 18295 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:33.879837 18295 webserver.cc:460] Webserver started at http://127.15.239.254:41179/ using document root <none> and password file <none>
I20260810 04:55:33.880168 18295 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:33.880244 18295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:33.880548 18295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:33.881896 18295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "bab0432a500d401d92d9a49caac1cf33"
format_stamp: "Formatted at 2026-08-10 04:55:33 on dist-test-slave-kvfs"
server_key: "3b50232a4d179475cfd82d7b950a5cbc"
server_key_iv: "bc630cc35aff0f577e56e4e41c08a1df"
server_key_version: "encryptionkey@0"
I20260810 04:55:33.882329 18295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "bab0432a500d401d92d9a49caac1cf33"
format_stamp: "Formatted at 2026-08-10 04:55:33 on dist-test-slave-kvfs"
server_key: "3b50232a4d179475cfd82d7b950a5cbc"
server_key_iv: "bc630cc35aff0f577e56e4e41c08a1df"
server_key_version: "encryptionkey@0"
I20260810 04:55:33.883915 18295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:55:33.884891 18321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:33.885098 18295 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:33.885221 18295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "bab0432a500d401d92d9a49caac1cf33"
format_stamp: "Formatted at 2026-08-10 04:55:33 on dist-test-slave-kvfs"
server_key: "3b50232a4d179475cfd82d7b950a5cbc"
server_key_iv: "bc630cc35aff0f577e56e4e41c08a1df"
server_key_version: "encryptionkey@0"
I20260810 04:55:33.885303 18295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:33.914140 18295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:33.916754 18295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:33.916951 18295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:33.922566 18295 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:40361
I20260810 04:55:33.922614 18397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:40361 every 8 connection(s)
I20260810 04:55:33.923087 18295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:33.924386 18398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:33.926512 18398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:33.932441 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18295
I20260810 04:55:33.932585 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:33.932853 16319 external_mini_cluster.cc:1428] Setting key 117a0900673dbe5fe5f20751bf207696
Aug 10 04:55:33 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:33.938730 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:33.927353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:40361 (local address 127.0.0.1:60048)
0810 04:55:33.927706 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:33.927761 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:33.928507 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:33.928884 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:33.928887 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:33.929233 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:33.929438 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:33.929443 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:33.930600 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:33.930601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:33.931364 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:33.931367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:33.931929 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:33.931930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:33.932004 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:33.932789 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:33.932803 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:33.934866 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:33.936962 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:33.936970 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:33.936973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:33.937200 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:33.937491 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:33.937492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:33.937492 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:33.937590 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:33.938018 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:33.938024 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:33.938094 (+ 70us) client_negotiation.cc:769] Sending connection context
0810 04:55:33.938215 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 04:55:33.938479 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":101,"thread_start_us":152,"threads_started":1}
I20260810 04:55:33.938730 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:33.927433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.15.239.254:40361)
0810 04:55:33.927725 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:33.927736 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:33.927894 (+ 158us) server_negotiation.cc:407] Connection header received
0810 04:55:33.928701 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:33.928704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:33.928732 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:33.928862 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:33.929558 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:33.930492 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:33.931474 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:33.931825 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:33.931954 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:33.934978 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:33.934994 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:33.934994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:33.935002 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:33.936827 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:33.937310 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:33.937314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:33.937315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:33.937409 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:33.937665 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:33.937666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:33.937666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:33.937942 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:33.938045 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:33.938250 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 04:55:33.938430 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":222,"thread_start_us":145,"threads_started":1}
I20260810 04:55:33.939616 18398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:33.940073 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:33.939907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51234)
0810 04:55:33.939961 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:33.940013 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:55:33.940227 18324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
I20260810 04:55:33.940704 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:33.940603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51236)
0810 04:55:33.940654 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:33.940679 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:55:33.940820 18398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:45569: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.15.239.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab.
Entry for principal kudu/127.15.239.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab.
I20260810 04:55:33.967203 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:45569
--webserver_interface=127.15.239.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab
--principal=kudu/127.15.239.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:40361,127.15.239.253:45569,127.15.239.252:36725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:55:33.990087 18398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } attempt: 1
I20260810 04:55:33.990779 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:33.990599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51248)
0810 04:55:33.990692 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:33.990734 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 04:55:33.991255 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:33.991164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51258)
0810 04:55:33.991209 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:33.991236 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 04:55:33.991370 18398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:45569: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
I20260810 04:55:34.059551 18398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } attempt: 2
I20260810 04:55:34.060289 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.060118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51260)
0810 04:55:34.060194 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.060244 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:55:34.060745 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.060590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51264)
0810 04:55:34.060662 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.060713 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 04:55:34.060904 18398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:45569: Network error: Client connection negotiation failed: client connection to 127.15.239.253:45569: connect: Connection refused (error 111)
W20260810 04:55:34.067085 18405 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:55:34.067338 18405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:34.067358 18405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:34.067380 18405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:34.068751 18405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:34.068796 18405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:34.068810 18405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:34.068825 18405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:34.068836 18405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:34.070462 18405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:40361,127.15.239.253:45569,127.15.239.252:36725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab
--principal=kudu/127.15.239.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:45569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.239.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:34.070766 18405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:34.071038 18405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:34.076735 18413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:34.076711 18419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:34.076856 18412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:34.076987 18405 server_base.cc:1034] running on GCE node
I20260810 04:55:34.077266 18405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:34.077571 18405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:34.078732 18405 hybrid_clock.cc:648] HybridClock initialized: now 1786337734078711 us; error 46 us; skew 500 ppm
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:34.082444 18405 init.cc:377] Logged in from keytab as kudu/127.15.239.253@KRBTEST.COM (short username kudu)
I20260810 04:55:34.083061 18405 webserver.cc:460] Webserver started at http://127.15.239.253:36551/ using document root <none> and password file <none>
I20260810 04:55:34.083356 18405 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:34.083413 18405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:34.083621 18405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:34.085095 18405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data/instance:
uuid: "fedea0113efa4058be2a9c3200c3610c"
format_stamp: "Formatted at 2026-08-10 04:55:34 on dist-test-slave-kvfs"
server_key: "10f26f3d7fccced4cf9676b74f42fbf5"
server_key_iv: "29e7eff65d6963357bfd6a6758ba24a4"
server_key_version: "encryptionkey@0"
I20260810 04:55:34.085546 18405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal/instance:
uuid: "fedea0113efa4058be2a9c3200c3610c"
format_stamp: "Formatted at 2026-08-10 04:55:34 on dist-test-slave-kvfs"
server_key: "10f26f3d7fccced4cf9676b74f42fbf5"
server_key_iv: "29e7eff65d6963357bfd6a6758ba24a4"
server_key_version: "encryptionkey@0"
I20260810 04:55:34.087193 18405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:55:34.088199 18428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:34.088440 18405 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:34.088581 18405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal
uuid: "fedea0113efa4058be2a9c3200c3610c"
format_stamp: "Formatted at 2026-08-10 04:55:34 on dist-test-slave-kvfs"
server_key: "10f26f3d7fccced4cf9676b74f42fbf5"
server_key_iv: "29e7eff65d6963357bfd6a6758ba24a4"
server_key_version: "encryptionkey@0"
I20260810 04:55:34.088666 18405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:34.107715 18405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:34.110402 18405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:34.110620 18405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:34.115974 18405 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.253:45569
I20260810 04:55:34.116012 18516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.253:45569 every 8 connection(s)
I20260810 04:55:34.116544 18405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
I20260810 04:55:34.117666 18517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:34.119675 18517 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:34.125808 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18405
I20260810 04:55:34.126003 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-1/wal/instance
I20260810 04:55:34.126245 16319 external_mini_cluster.cc:1428] Setting key 3ad8451755e6e4fee5bc5c9d6568d1df
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:34.131394 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.120705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60056 (local address 127.15.239.254:40361)
0810 04:55:34.120804 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.120807 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.121049 (+ 242us) server_negotiation.cc:407] Connection header received
0810 04:55:34.121661 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.121662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.121679 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.121749 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.122577 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.123141 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.124449 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.124682 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.124754 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.127634 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.127636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.127636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.127648 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.129532 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.130141 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.130142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.130143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.130206 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.130547 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.130548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.130548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.130686 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.130753 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.131124 (+ 371us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.131236 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 04:55:34.131471 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.120605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:40361 (local address 127.0.0.1:60056)
0810 04:55:34.120876 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.120933 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.121552 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.121856 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.121861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.122205 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.122477 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.122481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.123246 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.123247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.124333 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.124336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.124771 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.124772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.124913 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.125546 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.125556 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.127517 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.129625 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.129635 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.129639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.130049 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.130278 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.130279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.130280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.130444 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.130768 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.130775 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.130965 (+ 190us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.131077 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.131236 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":124,"threads_started":1}
I20260810 04:55:34.132241 18517 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.239.252@KRBTEST.COM; defaulting to no policy
I20260810 04:55:34.140702 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.132730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51272 (local address 127.15.239.253:45569)
0810 04:55:34.132975 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.132980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.133000 (+ 20us) server_negotiation.cc:407] Connection header received
0810 04:55:34.133019 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.133021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.133034 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.133123 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.133458 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.134222 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.134933 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.135276 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.135363 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.137456 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.137468 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.137468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.137476 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.139235 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.139619 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.139624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.139624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.139685 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.139950 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.139951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.139952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.140227 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.140323 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.140488 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.140616 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":205,"thread_start_us":146,"threads_started":1}
I20260810 04:55:34.140679 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.132653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51272)
0810 04:55:34.132711 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.132724 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.132765 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.133138 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.133139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.133315 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.133380 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.133381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.134320 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.134321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.134848 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.134850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.135356 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.135357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.135433 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.135943 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.135955 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.137364 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.139325 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.139326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.139327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.139529 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.139757 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.139758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.139758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.139852 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.140327 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.140328 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.140373 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.140442 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.140558 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.252@KRBTEST.COM" created.
I20260810 04:55:34.141983 18517 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:34.142441 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.142283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44438)
0810 04:55:34.142343 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.142408 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 04:55:34.142671 18429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
I20260810 04:55:34.143245 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.143131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44440)
0810 04:55:34.143181 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.143214 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 04:55:34.143481 18517 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:36725: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
I20260810 04:55:34.152144 18398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } attempt: 3
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab.
Entry for principal kudu/127.15.239.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab.
I20260810 04:55:34.159653 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:36725
--webserver_interface=127.15.239.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab
--principal=kudu/127.15.239.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:40361,127.15.239.253:45569,127.15.239.252:36725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:55:34.160794 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.152624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51280)
0810 04:55:34.152725 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.152741 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.152815 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.152969 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.152970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.153212 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.153317 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.153321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.154168 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.154170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.154761 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.154762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.155197 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.155199 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.155282 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.155814 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.155820 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.157508 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.159445 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.159447 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.159447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.159695 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.159967 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.159969 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.159969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.160111 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.160464 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.160465 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.160535 (+ 70us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.160601 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.160710 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 04:55:34.160936 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.152726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51280 (local address 127.15.239.253:45569)
0810 04:55:34.152795 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.152797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.152808 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:55:34.152881 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.152882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.152896 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.152977 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.153424 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.154064 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.154864 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.155099 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.155165 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.157604 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.157606 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.157606 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.157614 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.159362 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.159795 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.159796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.159797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.159869 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.160193 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.160194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.160194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.160363 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.160434 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.160656 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.160769 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 04:55:34.161343 18398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:34.161758 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.161640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44448)
0810 04:55:34.161694 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.161725 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 04:55:34.162163 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.162078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44450)
0810 04:55:34.162123 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.162146 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:55:34.162266 18398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:36725: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
I20260810 04:55:34.192764 18517 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } attempt: 1
I20260810 04:55:34.193444 18398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } attempt: 1
I20260810 04:55:34.193550 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.193353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44464)
0810 04:55:34.193443 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.193502 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 04:55:34.194051 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.193886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44468)
0810 04:55:34.193968 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.194011 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 04:55:34.194135 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.193982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44478)
0810 04:55:34.194040 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.194078 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 04:55:34.194320 18517 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:36725: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
I20260810 04:55:34.194474 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.194335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44492)
0810 04:55:34.194407 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.194442 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260810 04:55:34.194618 18398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:36725: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
W20260810 04:55:34.257968 18535 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:55:34.258247 18535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:34.258267 18535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:34.258289 18535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:34.259480 18535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:34.259516 18535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:34.259531 18535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:34.259542 18535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:34.259596 18535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:34.261267 18535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:40361,127.15.239.253:45569,127.15.239.252:36725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab
--principal=kudu/127.15.239.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:36725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.239.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:34.261519 18535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:34.261734 18535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:55:34.262522 18517 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } attempt: 2
I20260810 04:55:34.263176 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.262962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44504)
0810 04:55:34.263047 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.263125 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 04:55:34.263652 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.263515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44508)
0810 04:55:34.263587 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.263626 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 04:55:34.263783 18517 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:36725: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
W20260810 04:55:34.267498 18546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:34.267474 18542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:34.267477 18541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:34.267936 18535 server_base.cc:1034] running on GCE node
I20260810 04:55:34.268280 18535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:34.268625 18535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:34.269817 18535 hybrid_clock.cc:648] HybridClock initialized: now 1786337734269790 us; error 42 us; skew 500 ppm
I20260810 04:55:34.269778 18398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } attempt: 2
I20260810 04:55:34.270283 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.270122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44522)
0810 04:55:34.270193 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.270236 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 04:55:34.270663 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.270552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44528)
0810 04:55:34.270599 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.270629 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:55:34.270761 18398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:36725: Network error: Client connection negotiation failed: client connection to 127.15.239.252:36725: connect: Connection refused (error 111)
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:34.273064 18535 init.cc:377] Logged in from keytab as kudu/127.15.239.252@KRBTEST.COM (short username kudu)
I20260810 04:55:34.273579 18535 webserver.cc:460] Webserver started at http://127.15.239.252:34645/ using document root <none> and password file <none>
I20260810 04:55:34.273875 18535 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:34.273952 18535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:34.274118 18535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:34.275341 18535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data/instance:
uuid: "6b7b75ba453245bf93bd8cc0923a6e88"
format_stamp: "Formatted at 2026-08-10 04:55:34 on dist-test-slave-kvfs"
server_key: "40049c860d0c8151547f2cac90827db0"
server_key_iv: "c2231281acb6ce6c757e096255b62b5e"
server_key_version: "encryptionkey@0"
I20260810 04:55:34.275763 18535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal/instance:
uuid: "6b7b75ba453245bf93bd8cc0923a6e88"
format_stamp: "Formatted at 2026-08-10 04:55:34 on dist-test-slave-kvfs"
server_key: "40049c860d0c8151547f2cac90827db0"
server_key_iv: "c2231281acb6ce6c757e096255b62b5e"
server_key_version: "encryptionkey@0"
I20260810 04:55:34.277298 18535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:55:34.278164 18553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:34.278388 18535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:34.278497 18535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal
uuid: "6b7b75ba453245bf93bd8cc0923a6e88"
format_stamp: "Formatted at 2026-08-10 04:55:34 on dist-test-slave-kvfs"
server_key: "40049c860d0c8151547f2cac90827db0"
server_key_iv: "c2231281acb6ce6c757e096255b62b5e"
server_key_version: "encryptionkey@0"
I20260810 04:55:34.278579 18535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:34.303948 18535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:34.306922 18535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:34.307120 18535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:34.312652 18535 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.252:36725
I20260810 04:55:34.312693 18635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.252:36725 every 8 connection(s)
I20260810 04:55:34.313190 18535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
I20260810 04:55:34.314426 18636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:34.316565 18636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:34.318473 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18535
I20260810 04:55:34.318619 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786337435403234-16319-0/minicluster-data/master-2/wal/instance
I20260810 04:55:34.318864 16319 external_mini_cluster.cc:1428] Setting key 6a2eb6ac2726ab7b7e550686baa8579a
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:34.329351 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.317567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60064 (local address 127.15.239.254:40361)
0810 04:55:34.317643 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.317645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.317964 (+ 319us) server_negotiation.cc:407] Connection header received
0810 04:55:34.318795 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.318797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.318817 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.318907 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.320054 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.320633 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.321682 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.321900 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.321960 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.325289 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.325291 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.325291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.325302 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.327283 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.327810 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.327812 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.327812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.327891 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.328322 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.328322 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.328323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.328520 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.328603 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.329098 (+ 495us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.329233 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 04:55:34.329986 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.319445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44542 (local address 127.15.239.252:36725)
0810 04:55:34.319661 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.319666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.319730 (+ 64us) server_negotiation.cc:407] Connection header received
0810 04:55:34.319801 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.319803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.319820 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.319898 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.320652 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.321551 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.322590 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.323051 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.323121 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.325916 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.325925 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.325925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.325933 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.327943 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.328463 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.328468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.328468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.328530 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.328799 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.328800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.328801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.328981 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.329179 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.329512 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.329615 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":185,"thread_start_us":101,"threads_started":1}
I20260810 04:55:34.329986 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.317528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:40361 (local address 127.0.0.1:60064)
0810 04:55:34.317782 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.317832 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.318638 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.319041 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.319047 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.319456 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.319828 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.319852 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.320724 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.320725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.321561 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.321563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.321988 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.321989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.322149 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.323009 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.323020 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.325174 (+ 2154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.327387 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.327395 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.327398 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.327726 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.328033 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.328035 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.328035 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.328231 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.328626 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.328635 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.328845 (+ 210us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.329002 (+ 157us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.329219 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":124,"threads_started":1}
I20260810 04:55:34.330848 18636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:34.338985 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.331375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.15.239.253:45569)
0810 04:55:34.331424 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.331426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.331489 (+ 63us) server_negotiation.cc:407] Connection header received
0810 04:55:34.331559 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.331560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.331570 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.331618 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.331985 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.332558 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.333256 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.333547 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.333622 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.335740 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.335742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.335742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.335750 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.337634 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.337970 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.337971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.337972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.338040 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.338395 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.338397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.338397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.338556 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.338641 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.338799 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.338878 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:55:34.339004 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.331286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:45569 (local address 127.0.0.1:51296)
0810 04:55:34.331439 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.331450 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.331496 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.331642 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.331643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.331811 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.331906 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.331908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.332645 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.332646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.333155 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.333156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.333632 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.333633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.333711 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.334285 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.334290 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.335629 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.337722 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.337723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.337723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.337892 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.338137 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.338138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.338138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.338195 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.338632 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.338633 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.338687 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.338768 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.338878 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260810 04:55:34.339474 18636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:34.340451 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.331171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.15.239.254:40361)
0810 04:55:34.331230 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.331232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.331252 (+ 20us) server_negotiation.cc:407] Connection header received
0810 04:55:34.331314 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.331315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.331326 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.331384 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.332143 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.332621 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.333327 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.333535 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.333621 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.336397 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.336398 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.336399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.336407 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.338127 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.338491 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.338492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.338493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.338560 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.338769 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.338770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.338770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.338904 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.340260 (+ 1356us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.340299 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.340376 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:55:34.347222 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.339803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44552)
0810 04:55:34.339854 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.339865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.339902 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.340046 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.340047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.340194 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.340223 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.340225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.341065 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.341066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.341880 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.341882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.342348 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.342349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.342391 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.342961 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.342966 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.344330 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.345993 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.345994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.345995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.346243 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.346544 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.346545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.346546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.346627 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.346899 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.346900 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.346953 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.347027 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.347125 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 04:55:34.347335 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.339890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44552 (local address 127.15.239.252:36725)
0810 04:55:34.339931 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.339940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.339948 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:55:34.339965 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.339966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.339974 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.340054 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.340307 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.340985 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.341970 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.342273 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.342344 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.344438 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.344440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.344440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.344448 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.345895 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.346354 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.346355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.346355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.346452 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.346703 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.346704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.346704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.346817 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.346878 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.347072 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.347189 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":22}
I20260810 04:55:34.349850 18636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: Bootstrap starting.
I20260810 04:55:34.349924 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.341231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51304 (local address 127.15.239.253:45569)
0810 04:55:34.341267 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.341269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.341276 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:55:34.341296 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.341296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.341305 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.341355 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.341918 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.342574 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.343553 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.343769 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.343848 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.346949 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.346955 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.346956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.346963 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.348749 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.349168 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.349169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.349169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.349222 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.349457 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.349457 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.349458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.349564 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.349728 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.349798 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.349859 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 04:55:34.351187 18636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:34.351605 18636 log.cc:824] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:34.352257 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:34.352658 18636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: No bootstrap required, opened a new log
I20260810 04:55:34.353446 18356 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bab0432a500d401d92d9a49caac1cf33"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60076
I20260810 04:55:34.354938 18517 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } attempt: 3
I20260810 04:55:34.355083 18636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.355278 18636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7b75ba453245bf93bd8cc0923a6e88, State: Initialized, Role: FOLLOWER
I20260810 04:55:34.355386 18636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.355736 18645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.355834 18636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:34.355894 18645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:55:34.358692 18658 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:34.358768 18658 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337734, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:34.358590 18535 master_runner.cc:186] Error getting master registration for 127.15.239.254:40361: OK, instance_id { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" instance_seqno: 1786337733920985 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:55:34.361747 18535 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:55:34.364356 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.355304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44564 (local address 127.15.239.252:36725)
0810 04:55:34.355354 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.355356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.355383 (+ 27us) server_negotiation.cc:407] Connection header received
0810 04:55:34.355468 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.355469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.355480 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.355532 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.356080 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.356725 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.357791 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.358075 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.358148 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.360841 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.360843 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.360843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.360852 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.362868 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.363351 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.363352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.363352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.363417 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.363665 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.363666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.363666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.363859 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.363927 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.364158 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.364247 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:55:34.364382 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.355271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44564)
0810 04:55:34.355329 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.355343 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.355402 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.355566 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.355568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.355779 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.355842 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.355845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.356813 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.356815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.357675 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.357679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.358164 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.358166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.358263 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.358852 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.358859 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.360730 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.362982 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.362984 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.362984 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.363264 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.363503 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.363504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.363504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.363592 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.363939 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.363940 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.364002 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.364129 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.364270 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:55:34.366204 18517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: Bootstrap starting.
I20260810 04:55:34.367002 18517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:34.367354 18517 log.cc:824] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:34.368402 18517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: No bootstrap required, opened a new log
I20260810 04:55:34.369887 18398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } attempt: 3
I20260810 04:55:34.370241 18517 raft_consensus.cc:348] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.370631 18517 raft_consensus.cc:729] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fedea0113efa4058be2a9c3200c3610c, State: Initialized, Role: FOLLOWER
I20260810 04:55:34.370746 18517 consensus_queue.cc:260] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.371213 18517 sys_catalog.cc:564] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:34.372303 18663 sys_catalog.cc:455] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.372550 18663 sys_catalog.cc:458] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: This master's current role is: FOLLOWER
W20260810 04:55:34.373713 18678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:34.373780 18678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 04:55:34 dist-test-slave-kvfs krb5kdc[18278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337733, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:34.374503 18405 master_runner.cc:186] Error getting master registration for 127.15.239.254:40361: OK, instance_id { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" instance_seqno: 1786337733920985 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:55:34.377923 18405 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:55:34.379433 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.370382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44572 (local address 127.15.239.252:36725)
0810 04:55:34.370437 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.370439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.370452 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:55:34.370527 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.370528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.370543 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.370611 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.371040 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.371804 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.372944 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.373277 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.373393 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.376092 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.376095 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.376095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.376106 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.378091 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.378538 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.378540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.378540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.378615 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.378820 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.378821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.378822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.378985 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.379051 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.379230 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.379324 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:55:34.379432 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.370320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:36725 (local address 127.0.0.1:44572)
0810 04:55:34.370389 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:34.370405 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:34.370465 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:34.370627 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:34.370628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:34.370851 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:34.370930 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.370933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.371935 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.371937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.372818 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:34.372822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.373415 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.373417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:34.373508 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.374088 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:34.374094 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:34.375921 (+ 1827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:34.378202 (+ 2281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.378203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.378204 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.378450 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.378677 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:34.378678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:34.378678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:34.378761 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:34.379040 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:34.379041 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:34.379104 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 04:55:34.379199 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 04:55:34.379326 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 04:55:34.382081 18398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33: Bootstrap starting.
I20260810 04:55:34.383123 18398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:34.383507 18398 log.cc:824] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:34.384620 18398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33: No bootstrap required, opened a new log
I20260810 04:55:34.386313 18398 raft_consensus.cc:348] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.386500 18398 raft_consensus.cc:729] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab0432a500d401d92d9a49caac1cf33, State: Initialized, Role: FOLLOWER
I20260810 04:55:34.386603 18398 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.386967 18398 sys_catalog.cc:564] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:34.387001 18356 raft_consensus.cc:482] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 04:55:34.387063 18356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:34.388283 18356 raft_consensus.cc:504] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.389194 18473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bab0432a500d401d92d9a49caac1cf33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fedea0113efa4058be2a9c3200c3610c"
I20260810 04:55:34.389209 18597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bab0432a500d401d92d9a49caac1cf33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6b7b75ba453245bf93bd8cc0923a6e88"
I20260810 04:55:34.389369 18473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:34.389428 18597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:34.390297 18597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab0432a500d401d92d9a49caac1cf33 in term 1.
I20260810 04:55:34.390554 18473 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bab0432a500d401d92d9a49caac1cf33 in term 1.
I20260810 04:55:34.388679 18356 leader_election.cc:288] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [CANDIDATE]: Term 1 election: Requested vote from peers fedea0113efa4058be2a9c3200c3610c (127.15.239.253:45569), 6b7b75ba453245bf93bd8cc0923a6e88 (127.15.239.252:36725)
I20260810 04:55:34.390647 18323 leader_election.cc:302] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b7b75ba453245bf93bd8cc0923a6e88, bab0432a500d401d92d9a49caac1cf33; no voters:
I20260810 04:55:34.392196 18709 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.392360 18709 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:34.392418 18709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:34.392484 18709 raft_consensus.cc:686] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [term 1 LEADER]: Becoming Leader. State: Replica: bab0432a500d401d92d9a49caac1cf33, State: Running, Role: LEADER
I20260810 04:55:34.392584 18709 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } }
I20260810 04:55:34.393131 18709 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab0432a500d401d92d9a49caac1cf33. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.393218 18709 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:34.394045 18720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:34.394090 18295 master_runner.cc:263] No leader master found from master bab0432a500d401d92d9a49caac1cf33
I20260810 04:55:34.394124 18295 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:55:34.394728 18720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:34.396659 18597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [term 1 FOLLOWER]: Refusing update from remote peer bab0432a500d401d92d9a49caac1cf33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:34.396757 18473 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [term 1 FOLLOWER]: Refusing update from remote peer bab0432a500d401d92d9a49caac1cf33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:34.397059 18681 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:34.397208 18709 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:34.398682 18663 sys_catalog.cc:455] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab0432a500d401d92d9a49caac1cf33. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.398691 18645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab0432a500d401d92d9a49caac1cf33. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.398798 18663 sys_catalog.cc:458] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:34.398799 18645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:34.413918 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.400378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44584 (local address 127.15.239.252:36725)
0810 04:55:34.400429 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.400432 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.404207 (+ 3775us) server_negotiation.cc:407] Connection header received
0810 04:55:34.404326 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.404327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.404341 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.404375 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.405435 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.406490 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.408049 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.408484 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.408557 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.410634 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.410636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.410636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.410645 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.412535 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.412973 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.412974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.412975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.413035 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.413236 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.413237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.413238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.413387 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.413492 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.413712 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.413795 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:55:34.415330 18681 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.415462 18681 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:34.415838 18720 catalog_manager.cc:1347] Generated new cluster ID: 05cd6e8ec79c4720b295eab77b3b7c1e
I20260810 04:55:34.415899 18720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:34.416062 18663 sys_catalog.cc:455] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.416191 18663 sys_catalog.cc:458] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:34.416415 18723 mvcc.cc:205] Tried to move back new op lower bound from 7316839360086155264 to 7316839360073138176. Current Snapshot: MvccSnapshot[applied={T|T < 7316839360086155264 or (T in {7316839360086155264})}]
I20260810 04:55:34.416642 18727 mvcc.cc:205] Tried to move back new op lower bound from 7316839360086155264 to 7316839360073138176. Current Snapshot: MvccSnapshot[applied={T|T < 7316839360086155264}]
I20260810 04:55:34.428968 18681 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.429117 18681 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:34.429749 18645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bab0432a500d401d92d9a49caac1cf33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bab0432a500d401d92d9a49caac1cf33" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 40361 } } peers { permanent_uuid: "fedea0113efa4058be2a9c3200c3610c" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 45569 } } peers { permanent_uuid: "6b7b75ba453245bf93bd8cc0923a6e88" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 36725 } } }
I20260810 04:55:34.429868 18645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:34.429943 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.400695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51310 (local address 127.15.239.253:45569)
0810 04:55:34.400746 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.400748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.405518 (+ 4770us) server_negotiation.cc:407] Connection header received
0810 04:55:34.405617 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.405619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.405631 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.405662 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.406429 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.407185 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.408297 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.408613 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.408656 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.424323 (+ 15667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.424324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.424325 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.424334 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.426084 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.427229 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.427230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.427231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.427297 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.429029 (+ 1732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.429031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.429031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.429196 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.429285 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.429744 (+ 459us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.429838 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:55:34.430004 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:34.400959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60084 (local address 127.15.239.254:40361)
0810 04:55:34.401003 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.401005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.409585 (+ 8580us) server_negotiation.cc:407] Connection header received
0810 04:55:34.409696 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.409697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.409710 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.409741 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.410386 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.411480 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.412543 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:34.412846 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:34.412889 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:34.422020 (+ 9131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:34.422022 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:34.422023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:34.422032 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:34.423856 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.426520 (+ 2664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.426521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.426522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.426589 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:34.426792 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:34.426793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:34.426793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:34.426934 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:34.427025 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:34.428808 (+ 1783us) server_negotiation.cc:299] Negotiation successful
0810 04:55:34.428919 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 04:55:34.430132 18728 mvcc.cc:205] Tried to move back new op lower bound from 7316839360086155264 to 7316839360073138176. Current Snapshot: MvccSnapshot[applied={T|T < 7316839360086155264}]
I20260810 04:55:34.440099 18720 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:34.441136 18720 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:34.449568 18720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bab0432a500d401d92d9a49caac1cf33: Generated new TSK 0
I20260810 04:55:34.449847 18720 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:55:34.480415 18401 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.478764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60086 (local address 127.15.239.254:40361)
0810 04:55:34.478828 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.478831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.479568 (+ 737us) server_negotiation.cc:407] Connection header received
0810 04:55:34.479691 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.479693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.479706 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.479740 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.480314 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60086: BlockingRecv error: recv got EOF from 127.0.0.1:60086 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260810 04:55:34.481366 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.479257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51320 (local address 127.15.239.253:45569)
0810 04:55:34.479306 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.479308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.480714 (+ 1406us) server_negotiation.cc:407] Connection header received
0810 04:55:34.480813 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.480815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.480828 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.480858 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.481268 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51320: BlockingRecv error: recv got EOF from 127.0.0.1:51320 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 04:55:34.482484 18641 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.481759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44592 (local address 127.15.239.252:36725)
0810 04:55:34.481812 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.481814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.481932 (+ 118us) server_negotiation.cc:407] Connection header received
0810 04:55:34.482068 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.482070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.482082 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.482112 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.482409 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44592: BlockingRecv error: recv got EOF from 127.0.0.1:44592 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260810 04:55:34.485283 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.484005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51332 (local address 127.15.239.253:45569)
0810 04:55:34.484083 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.484086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.484699 (+ 613us) server_negotiation.cc:407] Connection header received
0810 04:55:34.484828 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.484829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.484853 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.484882 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.485227 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51332: BlockingRecv error: recv got EOF from 127.0.0.1:51332 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 04:55:34.488618 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.487710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51338 (local address 127.15.239.253:45569)
0810 04:55:34.487746 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.487748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.487998 (+ 250us) server_negotiation.cc:407] Connection header received
0810 04:55:34.488142 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.488143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.488155 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.488188 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.488556 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51338: BlockingRecv error: recv got EOF from 127.0.0.1:51338 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 04:55:34.492888 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.491950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51344 (local address 127.15.239.253:45569)
0810 04:55:34.492013 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.492035 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.492306 (+ 271us) server_negotiation.cc:407] Connection header received
0810 04:55:34.492412 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.492413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.492425 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.492456 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.492821 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51344: BlockingRecv error: recv got EOF from 127.0.0.1:51344 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 04:55:34.499089 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.498215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51354 (local address 127.15.239.253:45569)
0810 04:55:34.498256 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.498258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.498515 (+ 257us) server_negotiation.cc:407] Connection header received
0810 04:55:34.498613 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.498614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.498625 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.498655 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.499038 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51354: BlockingRecv error: recv got EOF from 127.0.0.1:51354 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:55:34.509786 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.508733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.15.239.253:45569)
0810 04:55:34.508782 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.508784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.509115 (+ 331us) server_negotiation.cc:407] Connection header received
0810 04:55:34.509227 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.509229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.509242 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.509276 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.509703 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51366: BlockingRecv error: recv got EOF from 127.0.0.1:51366 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 04:55:34.528781 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.527551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.15.239.253:45569)
0810 04:55:34.527613 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.527616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.527970 (+ 354us) server_negotiation.cc:407] Connection header received
0810 04:55:34.528136 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.528137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.528152 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.528190 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.528686 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51382: BlockingRecv error: recv got EOF from 127.0.0.1:51382 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260810 04:55:34.563915 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.562724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.15.239.253:45569)
0810 04:55:34.562793 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.562797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.563179 (+ 382us) server_negotiation.cc:407] Connection header received
0810 04:55:34.563296 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.563297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.563312 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.563344 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.563829 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51398: BlockingRecv error: recv got EOF from 127.0.0.1:51398 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260810 04:55:34.630975 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.629912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51412 (local address 127.15.239.253:45569)
0810 04:55:34.630058 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.630060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.630093 (+ 33us) server_negotiation.cc:407] Connection header received
0810 04:55:34.630195 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.630196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.630212 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.630292 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.630848 (+ 556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51412: BlockingRecv error: recv got EOF from 127.0.0.1:51412 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260810 04:55:34.761662 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:34.760581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51418 (local address 127.15.239.253:45569)
0810 04:55:34.760702 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:34.760704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:34.760770 (+ 66us) server_negotiation.cc:407] Connection header received
0810 04:55:34.760845 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:34.760846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:34.760861 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:34.760916 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:34.761481 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51418: BlockingRecv error: recv got EOF from 127.0.0.1:51418 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260810 04:55:35.020509 18522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:35.019590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51422 (local address 127.15.239.253:45569)
0810 04:55:35.019695 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:35.019698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:35.019711 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:55:35.019780 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:35.019782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:35.019803 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:35.019885 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:35.020400 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51422: BlockingRecv error: recv got EOF from 127.0.0.1:51422 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 04:55:35.359431 18658 catalog_manager.cc:1259] Loaded cluster ID: 05cd6e8ec79c4720b295eab77b3b7c1e
I20260810 04:55:35.359596 18658 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: loading cluster ID for follower catalog manager: success
I20260810 04:55:35.360610 18658 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: acquiring CA information for follower catalog manager: success
I20260810 04:55:35.360930 18658 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6b7b75ba453245bf93bd8cc0923a6e88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:55:35.374415 18678 catalog_manager.cc:1259] Loaded cluster ID: 05cd6e8ec79c4720b295eab77b3b7c1e
I20260810 04:55:35.374547 18678 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: loading cluster ID for follower catalog manager: success
I20260810 04:55:35.375492 18678 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: acquiring CA information for follower catalog manager: success
I20260810 04:55:35.375866 18678 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fedea0113efa4058be2a9c3200c3610c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:55:35.537029 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:35.534030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51430 (local address 127.15.239.253:45569)
0810 04:55:35.534199 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:35.534201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:35.534219 (+ 18us) server_negotiation.cc:407] Connection header received
0810 04:55:35.534259 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:35.534260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:35.534355 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:35.534463 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:35.534681 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.535249 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.536161 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.536397 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.536459 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:35.536642 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:35.536793 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:35.536862 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:35.536907 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 04:55:35.536927 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":98,"threads_started":1}
I20260810 04:55:35.542016 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:35.539342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.15.239.252:36725)
0810 04:55:35.539483 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:35.539485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:35.539495 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:55:35.539542 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:35.539543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:35.539590 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:35.539679 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:35.539786 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.540392 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.541139 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.541384 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.541454 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:35.541602 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:35.541728 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:35.541818 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:35.541906 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 04:55:35.541932 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
I20260810 04:55:35.547195 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:35.544174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44612 (local address 127.15.239.252:36725)
0810 04:55:35.544385 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:35.544388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:35.544395 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:55:35.544419 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:35.544420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:35.544432 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:35.544480 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:35.544675 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.545139 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.546337 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.546645 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.546704 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:35.546919 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:35.546963 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:35.547012 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:35.547071 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 04:55:35.547094 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260810 04:55:35.547348 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:35.544066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51436 (local address 127.15.239.253:45569)
0810 04:55:35.544111 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:35.544113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:35.544184 (+ 71us) server_negotiation.cc:407] Connection header received
0810 04:55:35.544259 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:35.544260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:35.544277 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:35.544343 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:35.544462 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.545269 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.546337 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.546648 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.546688 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:35.546986 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:35.547028 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:35.547090 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:35.547226 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 04:55:35.547260 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:55:35.547618 18861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:35.543992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60100 (local address 127.15.239.254:40361)
0810 04:55:35.544268 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:35.544271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:35.544282 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:55:35.544343 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:35.544343 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:35.544415 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:35.544524 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:35.544671 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.545473 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.546337 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:35.546583 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:35.546667 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:35.546934 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:35.547077 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:35.547450 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:35.547475 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 04:55:35.547520 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":119,"threads_started":1}
I20260810 04:55:35.549974 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18295
I20260810 04:55:35.567735 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18405
I20260810 04:55:35.588521 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18535
2026-08-10T04:55:35Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3258 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 04:55:35 dist-test-slave-kvfs krb5kdc[18868](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 04:55:35 dist-test-slave-kvfs krb5kdc[18868](info): set up 2 sockets
Aug 10 04:55:35 dist-test-slave-kvfs krb5kdc[18868](info): commencing operation
krb5kdc: starting...
W20260810 04:55:36.911120 16319 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/test-user.keytab.
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T04:55:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:55:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.239.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
Entry for principal kudu/127.15.239.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab.
I20260810 04:55:37.052874 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36243
--webserver_interface=127.15.239.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36243,127.15.239.253:37979,127.15.239.252:33093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 04:55:37.148137 18888 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:55:37.148403 18888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:37.148422 18888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:37.148443 18888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:37.149710 18888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:37.149757 18888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:37.149772 18888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:37.149785 18888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:37.149843 18888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:37.151404 18888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36243,127.15.239.253:37979,127.15.239.252:33093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.254.keytab
--principal=kudu/127.15.239.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.254:36243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.239.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:37.151721 18888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:37.151993 18888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:37.157641 18901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:37.157670 18897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:37.157706 18898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:37.157999 18888 server_base.cc:1034] running on GCE node
I20260810 04:55:37.158285 18888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:37.158635 18888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:37.159801 18888 hybrid_clock.cc:648] HybridClock initialized: now 1786337737159791 us; error 34 us; skew 500 ppm
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:37.162735 18888 init.cc:377] Logged in from keytab as kudu/127.15.239.254@KRBTEST.COM (short username kudu)
I20260810 04:55:37.163252 18888 webserver.cc:460] Webserver started at http://127.15.239.254:40823/ using document root <none> and password file <none>
I20260810 04:55:37.163481 18888 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:37.163527 18888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:37.163633 18888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:37.164904 18888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data/instance:
uuid: "38e6d24fa8864419bc3d8c12977ad446"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "cfc511817ecaa857ad194110701e0f49"
server_key_iv: "af87cc36f38fe0425d103a59e266d328"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.165267 18888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal/instance:
uuid: "38e6d24fa8864419bc3d8c12977ad446"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "cfc511817ecaa857ad194110701e0f49"
server_key_iv: "af87cc36f38fe0425d103a59e266d328"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.166685 18888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 04:55:37.167531 18909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:37.167734 18888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:37.167831 18888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal
uuid: "38e6d24fa8864419bc3d8c12977ad446"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "cfc511817ecaa857ad194110701e0f49"
server_key_iv: "af87cc36f38fe0425d103a59e266d328"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.167894 18888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:37.192381 18888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:37.195021 18888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:37.195158 18888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:37.200192 18888 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.254:36243
I20260810 04:55:37.200255 18988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.254:36243 every 8 connection(s)
I20260810 04:55:37.200673 18888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/data/info.pb
I20260810 04:55:37.201812 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:37.203806 18990 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.209611 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18888
I20260810 04:55:37.209712 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-0/wal/instance
I20260810 04:55:37.209965 16319 external_mini_cluster.cc:1428] Setting key e5ef3bab54e0827d87336b3a5a342563
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:37.215139 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.204694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36243 (local address 127.0.0.1:37270)
0810 04:55:37.204985 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.205019 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.205578 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.205914 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.205917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.206216 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.206402 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.206405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.207531 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.207531 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.208366 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.208369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.208887 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.208888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.208956 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.209621 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.209631 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.211373 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.213428 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.213437 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.213440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.213752 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.214036 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.214037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.214037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.214163 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.214557 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.214564 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.214631 (+ 67us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.214756 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.214923 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":115,"threads_started":1}
I20260810 04:55:37.215227 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.204710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37270 (local address 127.15.239.254:36243)
0810 04:55:37.204951 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.204962 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.205116 (+ 154us) server_negotiation.cc:407] Connection header received
0810 04:55:37.205759 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.205762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.205783 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.205890 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.206501 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.207430 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.208449 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.208792 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.208900 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.211476 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.211485 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.211486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.211496 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.213324 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.213850 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.213852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.213853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.213964 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.214240 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.214241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.214241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.214490 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.214558 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.214826 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.215041 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":192,"spinlock_wait_cycles":896,"thread_start_us":111,"threads_started":1}
I20260810 04:55:37.216215 18990 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.216662 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.216499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35096)
0810 04:55:37.216555 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.216626 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 04:55:37.216851 18914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
I20260810 04:55:37.217398 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.217265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35112)
0810 04:55:37.217320 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.217355 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:55:37.217533 18990 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:37979: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.15.239.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab.
Entry for principal kudu/127.15.239.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab.
I20260810 04:55:37.243033 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:37979
--webserver_interface=127.15.239.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab
--principal=kudu/127.15.239.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36243,127.15.239.253:37979,127.15.239.252:33093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:55:37.266789 18990 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } attempt: 1
I20260810 04:55:37.267436 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.267265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35126)
0810 04:55:37.267340 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.267388 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 04:55:37.267834 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.267724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35128)
0810 04:55:37.267775 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.267809 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 04:55:37.267923 18990 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:37979: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
I20260810 04:55:37.336133 18990 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } attempt: 2
I20260810 04:55:37.336766 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.336589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35134)
0810 04:55:37.336671 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.336723 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 04:55:37.337272 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.337128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35144)
0810 04:55:37.337201 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.337231 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 04:55:37.337405 18990 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.253:37979: Network error: Client connection negotiation failed: client connection to 127.15.239.253:37979: connect: Connection refused (error 111)
W20260810 04:55:37.341931 18999 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:55:37.342195 18999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:37.342236 18999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:37.342273 18999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:37.343500 18999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:37.343565 18999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:37.343590 18999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:37.343618 18999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:37.343648 18999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:37.345304 18999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36243,127.15.239.253:37979,127.15.239.252:33093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.253.keytab
--principal=kudu/127.15.239.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.253:37979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.239.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:37.345638 18999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:37.346122 18999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:55:37.352003 19007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:37.352046 19010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:37.352200 18999 server_base.cc:1034] running on GCE node
W20260810 04:55:37.352000 19005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:37.352581 18999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:37.352949 18999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:37.354107 18999 hybrid_clock.cc:648] HybridClock initialized: now 1786337737354082 us; error 38 us; skew 500 ppm
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:37.357232 18999 init.cc:377] Logged in from keytab as kudu/127.15.239.253@KRBTEST.COM (short username kudu)
I20260810 04:55:37.357761 18999 webserver.cc:460] Webserver started at http://127.15.239.253:44863/ using document root <none> and password file <none>
I20260810 04:55:37.358049 18999 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:37.358100 18999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:37.358279 18999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:37.359534 18999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data/instance:
uuid: "26bcc310f5744f54b846fdb1723362ed"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "0d76a4f90ed99dadd881b436eb2e5c88"
server_key_iv: "67b3bb61510b91646fc8e0fb507840f8"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.359968 18999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal/instance:
uuid: "26bcc310f5744f54b846fdb1723362ed"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "0d76a4f90ed99dadd881b436eb2e5c88"
server_key_iv: "67b3bb61510b91646fc8e0fb507840f8"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.361620 18999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:37.362527 19020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:37.362754 18999 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:37.362881 18999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal
uuid: "26bcc310f5744f54b846fdb1723362ed"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "0d76a4f90ed99dadd881b436eb2e5c88"
server_key_iv: "67b3bb61510b91646fc8e0fb507840f8"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.362982 18999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:37.373827 18999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:37.376466 18999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:37.376658 18999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:37.381735 18999 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.253:37979
I20260810 04:55:37.381771 19103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.253:37979 every 8 connection(s)
I20260810 04:55:37.382197 18999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/data/info.pb
I20260810 04:55:37.383294 19104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:37.385342 19104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.391469 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 18999
I20260810 04:55:37.391606 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-1/wal/instance
I20260810 04:55:37.391908 16319 external_mini_cluster.cc:1428] Setting key 275c8ed324f3b787f2ab9e1cc10476a2
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:37.396240 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.386219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37272 (local address 127.15.239.254:36243)
0810 04:55:37.386315 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.386318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.386561 (+ 243us) server_negotiation.cc:407] Connection header received
0810 04:55:37.387140 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.387141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.387155 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.387213 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.387955 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.388605 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.389674 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.389891 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.389949 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.392606 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.392608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.392608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.392618 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.394404 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.395014 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.395015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.395016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.395088 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.395419 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.395420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.395421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.395573 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.395638 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.396007 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.396158 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 04:55:37.396574 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.386162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36243 (local address 127.0.0.1:37272)
0810 04:55:37.386419 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.386464 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.387037 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.387316 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.387320 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.387624 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.387863 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.387868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.388716 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.388717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.389596 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.389599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.389969 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.389970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.390088 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.390701 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.390711 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.392500 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.394515 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.394525 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.394528 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.394909 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.395168 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.395169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.395170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.395330 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.395646 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.395654 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.395843 (+ 189us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.395976 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.396210 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":104,"threads_started":1}
I20260810 04:55:37.397287 19104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.239.252@KRBTEST.COM; defaulting to no policy
I20260810 04:55:37.406306 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.397660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35160)
0810 04:55:37.397737 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.397750 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.397801 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.398247 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.398248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.398432 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.398496 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.398497 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.399541 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.399543 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.400210 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.400213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.400787 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.400788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.400869 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.401395 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.401401 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.403021 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.405118 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.405119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.405119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.405303 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.405526 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.405527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.405527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.405588 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.405983 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.405984 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.406030 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.406099 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.406198 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 04:55:37.406427 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.397795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35160 (local address 127.15.239.253:37979)
0810 04:55:37.398044 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.398049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.398072 (+ 23us) server_negotiation.cc:407] Connection header received
0810 04:55:37.398095 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.398096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.398110 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.398244 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.398585 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.399423 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.400310 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.400677 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.400792 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.403126 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.403137 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.403137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.403146 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.405030 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.405386 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.405389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.405390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.405462 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.405644 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.405644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.405666 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.405871 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.405963 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.406145 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.406250 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":213,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.239.252@KRBTEST.COM" created.
I20260810 04:55:37.407195 19104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.407636 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.407502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47512)
0810 04:55:37.407556 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.407615 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 04:55:37.407822 19023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
I20260810 04:55:37.408455 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.408356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47518)
0810 04:55:37.408409 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.408437 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 04:55:37.408588 19104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:33093: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.239.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab.
Entry for principal kudu/127.15.239.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab.
I20260810 04:55:37.424758 16319 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvaRG_7/build/release/bin/kudu
/tmp/dist-test-taskvaRG_7/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:33093
--webserver_interface=127.15.239.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab
--principal=kudu/127.15.239.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.239.212:36971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.239.254:36243,127.15.239.253:37979,127.15.239.252:33093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 04:55:37.428580 18990 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } attempt: 3
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:55:37.437703 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.429037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35176)
0810 04:55:37.429127 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.429143 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.429222 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.429412 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.429413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.429603 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.429689 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.429691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.430780 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.430782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.431373 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.431375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.431978 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.431979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.432118 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.432668 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.432673 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.434362 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.436506 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.436507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.436508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.436724 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.436991 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.436992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.436992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.437068 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.437400 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.437401 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.437452 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.437512 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.437609 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 04:55:37.437815 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.429179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35176 (local address 127.15.239.253:37979)
0810 04:55:37.429254 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.429257 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.429270 (+ 13us) server_negotiation.cc:407] Connection header received
0810 04:55:37.429307 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.429308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.429324 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.429388 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.429782 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.430671 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.431477 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.431878 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.431963 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.434468 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.434470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.434471 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.434482 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.436377 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.436838 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.436840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.436840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.436915 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.437142 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.437143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.437143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.437322 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.437407 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.437564 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.437669 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 04:55:37.438359 18990 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.438932 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.438700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47526)
0810 04:55:37.438863 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.438906 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260810 04:55:37.439409 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.439267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47542)
0810 04:55:37.439335 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.439377 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 04:55:37.439555 18990 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:33093: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
I20260810 04:55:37.457895 19104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } attempt: 1
I20260810 04:55:37.458674 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.458495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47548)
0810 04:55:37.458576 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.458630 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 04:55:37.459131 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.459041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47550)
0810 04:55:37.459085 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.459112 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 04:55:37.459261 19104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:33093: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
I20260810 04:55:37.470727 18990 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } attempt: 1
I20260810 04:55:37.471467 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.471251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47556)
0810 04:55:37.471361 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.471418 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 04:55:37.472049 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.471836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47558)
0810 04:55:37.471926 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.471981 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260810 04:55:37.472234 18990 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:33093: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
I20260810 04:55:37.527418 19104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } attempt: 2
I20260810 04:55:37.528203 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.527954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47564)
0810 04:55:37.528062 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.528115 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 04:55:37.528650 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.528529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47576)
0810 04:55:37.528588 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.528615 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 04:55:37.528849 19104 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:33093: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
W20260810 04:55:37.539350 19113 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 04:55:37.539608 19113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:55:37.539647 19113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:55:37.539682 19113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:55:37.541447 19113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:55:37.541514 19113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 04:55:37.541538 19113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:55:37.541556 19113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:55:37.541576 19113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:55:37.543803 19113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.239.212:36971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.239.254:36243,127.15.239.253:37979,127.15.239.252:33093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/krb5kdc/kudu_127.15.239.252.keytab
--principal=kudu/127.15.239.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.239.252:33093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.239.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 03:54:01 UTC on ccycloud.quasar-icijmt.root.comops.site
build id 4577009
I20260810 04:55:37.544124 19113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:55:37.544435 19113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 04:55:37.547410 18990 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } attempt: 2
I20260810 04:55:37.548096 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.547880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47586)
0810 04:55:37.547969 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.548039 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 04:55:37.548488 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.548368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47602)
0810 04:55:37.548423 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.548455 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 04:55:37.548581 18990 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.239.252:33093: Network error: Client connection negotiation failed: client connection to 127.15.239.252:33093: connect: Connection refused (error 111)
W20260810 04:55:37.550516 19128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:37.550524 19127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:55:37.550532 19130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:55:37.550964 19113 server_base.cc:1034] running on GCE node
I20260810 04:55:37.551282 19113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:55:37.551668 19113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:55:37.552852 19113 hybrid_clock.cc:648] HybridClock initialized: now 1786337737552825 us; error 43 us; skew 500 ppm
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 04:55:37.556277 19113 init.cc:377] Logged in from keytab as kudu/127.15.239.252@KRBTEST.COM (short username kudu)
I20260810 04:55:37.557025 19113 webserver.cc:460] Webserver started at http://127.15.239.252:45037/ using document root <none> and password file <none>
I20260810 04:55:37.557331 19113 fs_manager.cc:359] Metadata directory not provided
I20260810 04:55:37.557412 19113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:55:37.557567 19113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:55:37.559430 19113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data/instance:
uuid: "c622d0bcc6504e9586906053fc04fa08"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "1bd1308f185b61d70c386cf1d31878c2"
server_key_iv: "8f37c77155c9d39655d0215da09cdd18"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.560011 19113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal/instance:
uuid: "c622d0bcc6504e9586906053fc04fa08"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "1bd1308f185b61d70c386cf1d31878c2"
server_key_iv: "8f37c77155c9d39655d0215da09cdd18"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.561704 19113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:37.562598 19141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:55:37.562774 19113 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:55:37.562886 19113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data,/tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal
uuid: "c622d0bcc6504e9586906053fc04fa08"
format_stamp: "Formatted at 2026-08-10 04:55:37 on dist-test-slave-kvfs"
server_key: "1bd1308f185b61d70c386cf1d31878c2"
server_key_iv: "8f37c77155c9d39655d0215da09cdd18"
server_key_version: "encryptionkey@0"
I20260810 04:55:37.562949 19113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:55:37.592597 19113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:55:37.595424 19113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:55:37.595569 19113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:55:37.600596 19113 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.252:33093
I20260810 04:55:37.600636 19208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.239.252:33093 every 8 connection(s)
I20260810 04:55:37.601091 19113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/data/info.pb
I20260810 04:55:37.602209 19209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:55:37.604210 19209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.607829 16319 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvaRG_7/build/release/bin/kudu as pid 19113
I20260810 04:55:37.607956 16319 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvaRG_7/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786337435403234-16319-0/minicluster-data/master-2/wal/instance
I20260810 04:55:37.608256 16319 external_mini_cluster.cc:1428] Setting key 31fb1aa532714bfd261246dbf93252e8
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:37.614989 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.605148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37280 (local address 127.15.239.254:36243)
0810 04:55:37.605228 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.605230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.605453 (+ 223us) server_negotiation.cc:407] Connection header received
0810 04:55:37.606009 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.606010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.606023 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.606097 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.606822 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.607361 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.609008 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.609231 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.609334 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.611730 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.611732 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.611732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.611741 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.613330 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.613789 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.613790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.613791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.613879 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.614159 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.614160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.614161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.614338 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.614420 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.614793 (+ 373us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.614893 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 04:55:37.615231 19213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.605086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.254:36243 (local address 127.0.0.1:37280)
0810 04:55:37.605301 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.605353 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.605907 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.606166 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.606170 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.606486 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.606722 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.606726 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.607483 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.607484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.608878 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.608882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.609340 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.609342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.609494 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.610089 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.610099 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.611629 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.613438 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.613446 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.613448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.613702 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.613956 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.613957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.613958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.614081 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.614413 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.614420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.614618 (+ 198us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.614740 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.614942 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":119,"threads_started":1}
I20260810 04:55:37.615926 19209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.617668 19217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.608747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47612 (local address 127.15.239.252:33093)
0810 04:55:37.608967 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.608973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.609044 (+ 71us) server_negotiation.cc:407] Connection header received
0810 04:55:37.609099 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.609102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.609132 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.609227 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.609923 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.610653 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.611533 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.611853 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.611938 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.614343 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.614350 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.614350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.614355 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.616401 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.616819 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.616823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.616823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.616889 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.617145 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.617146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.617146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.617288 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.617434 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.617533 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.617596 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":100,"threads_started":1}
I20260810 04:55:37.619982 19104 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } attempt: 3
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.254@KRBTEST.COM
I20260810 04:55:37.624505 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.616547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35182 (local address 127.15.239.253:37979)
0810 04:55:37.616634 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.616636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.616646 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:55:37.616679 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.616681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.616694 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.616760 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.617056 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.617743 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.618668 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.618897 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.618986 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.621469 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.621471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.621471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.621480 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.623189 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.623594 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.623596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.623596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.623662 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.623884 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.623885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.623885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.624073 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.624144 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.624306 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.624393 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 04:55:37.624511 19213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.616283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.253:37979 (local address 127.0.0.1:35182)
0810 04:55:37.616449 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.616474 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.616520 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.616785 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.616786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.616954 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.616994 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.616995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.617847 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.617848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.618597 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.618600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.618985 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.618986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.619048 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.619462 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.619467 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.621370 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.623276 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.623277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.623277 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.623523 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.623739 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.623740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.623741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.623805 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.624135 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.624136 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.624184 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.624266 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.624364 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.253@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:37.625241 19209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } has no permanent_uuid. Determining permanent_uuid...
I20260810 04:55:37.627306 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.618628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.15.239.254:36243)
0810 04:55:37.618673 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.618675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.618683 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:55:37.618705 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.618706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.618715 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.618771 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.619258 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.619724 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.620688 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.620996 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.621071 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.624056 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.624058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.624059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.624067 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.626002 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.626335 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.626337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.626337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.626406 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.626648 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.626648 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.626649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.626803 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.627061 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.627104 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.627186 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 04:55:37.628209 19217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.620374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.15.239.252:33093)
0810 04:55:37.620409 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.620411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.620420 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:55:37.620465 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.620465 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.620475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.620529 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.620866 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.621723 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.622784 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.622999 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.623077 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.625227 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.625229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.625229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.625236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.626989 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.627398 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.627399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.627400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.627465 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.627703 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.627704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.627704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.627813 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.627908 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.628083 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.628154 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":19}
I20260810 04:55:37.628242 19106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.620315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47626)
0810 04:55:37.620373 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.620382 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.620417 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.620542 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.620542 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.620738 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.620788 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.620790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.621814 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.621815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.622698 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.622700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.623077 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.623077 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.623138 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.623501 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.623506 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.625127 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.627088 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.627089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.627090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.627304 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.627552 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.627553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.627553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.627627 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.627896 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.627897 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.627942 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.628011 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.628132 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.252@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:37.630494 19104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: Bootstrap starting.
I20260810 04:55:37.631736 19104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:37.632258 19104 log.cc:824] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:37.633677 19104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: No bootstrap required, opened a new log
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.253@KRBTEST.COM
I20260810 04:55:37.634079 19213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.625541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47632)
0810 04:55:37.625597 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.625608 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.625648 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.626001 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.626002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.626151 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.626194 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.626196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.627088 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.627089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.627804 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.627807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.628651 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.628652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.628709 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.629106 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.629112 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.630340 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.632876 (+ 2536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.632877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.632878 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.633134 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.633354 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.633355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.633355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.633415 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.633802 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.633804 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.633853 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.633899 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.633995 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:55:37.634570 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.625636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47632 (local address 127.15.239.252:33093)
0810 04:55:37.625849 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.625851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.625858 (+ 7us) server_negotiation.cc:407] Connection header received
0810 04:55:37.625878 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.625878 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.625889 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.625974 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.626291 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.627007 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.627883 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.628206 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.628272 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.630429 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.630430 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.630431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.630436 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.632779 (+ 2343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.633215 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.633216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.633217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.633272 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.633499 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.633500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.633500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.633682 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.634305 (+ 623us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.634354 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.634444 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":134,"threads_started":1}
I20260810 04:55:37.636107 19104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.636281 19104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26bcc310f5744f54b846fdb1723362ed, State: Initialized, Role: FOLLOWER
I20260810 04:55:37.636381 19104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.636704 19225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.636757 19209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: Bootstrap starting.
I20260810 04:55:37.636883 19225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.636801 19104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:37.637583 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.628939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35188 (local address 127.15.239.253:37979)
0810 04:55:37.628983 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.628985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.629023 (+ 38us) server_negotiation.cc:407] Connection header received
0810 04:55:37.629094 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.629095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.629104 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.629147 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.629636 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.630255 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.631247 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.631596 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.631672 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.634469 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.634471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.634471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.634479 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.636224 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.636644 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.636646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.636646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.636703 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.636899 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.636901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.636901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.637050 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.637165 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.637382 (+ 217us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.637460 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 04:55:37.637652 19209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:37.638000 19209 log.cc:824] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:37.638965 19209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: No bootstrap required, opened a new log
W20260810 04:55:37.639278 19242 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:37.639339 19242 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:37.640916 19209 raft_consensus.cc:348] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.641067 19209 raft_consensus.cc:729] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c622d0bcc6504e9586906053fc04fa08, State: Initialized, Role: FOLLOWER
I20260810 04:55:37.641156 19209 consensus_queue.cc:260] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.641476 19245 sys_catalog.cc:455] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.641548 19209 sys_catalog.cc:564] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:37.641629 19245 sys_catalog.cc:458] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.640656 18999 master_runner.cc:186] Error getting master registration for 127.15.239.254:36243: OK, instance_id { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" instance_seqno: 1786337737198713 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:55:37.643380 18999 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 04:55:37.643783 19260 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:37.643837 19260 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:37.644032 16319 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 04:55:37.643913 19113 master_runner.cc:186] Error getting master registration for 127.15.239.254:36243: OK, instance_id { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" instance_seqno: 1786337737198713 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 04:55:37.646435 19113 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 04:55:37.645396 18951 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "38e6d24fa8864419bc3d8c12977ad446"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37296
I20260810 04:55:37.647743 18990 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } attempt: 3
Aug 10 04:55:37 dist-test-slave-kvfs krb5kdc[18868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786337737, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.254@KRBTEST.COM for kudu/127.15.239.252@KRBTEST.COM
I20260810 04:55:37.656764 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.648080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.239.252:33093 (local address 127.0.0.1:47640)
0810 04:55:37.648141 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 04:55:37.648153 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 04:55:37.648197 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 04:55:37.648399 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 04:55:37.648400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 04:55:37.648622 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 04:55:37.648691 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.648694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.649705 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.649706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.650538 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 04:55:37.650541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.651090 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.651091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 04:55:37.651156 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.651731 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 04:55:37.651737 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 04:55:37.653562 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 04:55:37.655543 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.655544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.655545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.655773 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.656032 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 04:55:37.656033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 04:55:37.656033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 04:55:37.656124 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 04:55:37.656425 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 04:55:37.656426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 04:55:37.656490 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 04:55:37.656549 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 04:55:37.656657 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 04:55:37.657265 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.648151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47640 (local address 127.15.239.252:33093)
0810 04:55:37.648195 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.648197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.648207 (+ 10us) server_negotiation.cc:407] Connection header received
0810 04:55:37.648265 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.648266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.648281 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.648343 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.648790 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.649600 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.650642 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.650964 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.651027 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.653660 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.653662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.653662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.653670 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.655432 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.655894 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.655895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.655896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.655956 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.656197 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.656198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.656198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.656334 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.656397 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.657078 (+ 681us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.657170 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:55:37.659410 18990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: Bootstrap starting.
I20260810 04:55:37.660375 18990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: Neither blocks nor log segments found. Creating new log.
I20260810 04:55:37.660715 18990 log.cc:824] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: Log is configured to *not* fsync() on all Append() calls
I20260810 04:55:37.661931 18990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: No bootstrap required, opened a new log
I20260810 04:55:37.664332 18990 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.664673 18990 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e6d24fa8864419bc3d8c12977ad446, State: Initialized, Role: FOLLOWER
I20260810 04:55:37.664871 18990 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.665382 19263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.665531 19263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.665769 18951 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 04:55:37.665843 18951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:37.666778 18951 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.667054 18951 leader_election.cc:288] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [CANDIDATE]: Term 1 election: Requested vote from peers 26bcc310f5744f54b846fdb1723362ed (127.15.239.253:37979), c622d0bcc6504e9586906053fc04fa08 (127.15.239.252:33093)
I20260810 04:55:37.667421 18990 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:55:37.668606 19060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38e6d24fa8864419bc3d8c12977ad446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "26bcc310f5744f54b846fdb1723362ed"
I20260810 04:55:37.668781 19060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:37.669840 19060 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38e6d24fa8864419bc3d8c12977ad446 in term 1.
I20260810 04:55:37.670408 19175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38e6d24fa8864419bc3d8c12977ad446" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c622d0bcc6504e9586906053fc04fa08"
I20260810 04:55:37.670568 19175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:55:37.671554 19175 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38e6d24fa8864419bc3d8c12977ad446 in term 1.
I20260810 04:55:37.671757 18914 leader_election.cc:302] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26bcc310f5744f54b846fdb1723362ed, 38e6d24fa8864419bc3d8c12977ad446; no voters:
I20260810 04:55:37.671881 19263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:55:37.672257 19263 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [term 1 LEADER]: Becoming Leader. State: Replica: 38e6d24fa8864419bc3d8c12977ad446, State: Running, Role: LEADER
I20260810 04:55:37.672372 19263 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } }
I20260810 04:55:37.672892 19263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e6d24fa8864419bc3d8c12977ad446. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.672968 19263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: This master's current role is: LEADER
W20260810 04:55:37.673978 19285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 04:55:37.674342 19285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 04:55:37.679989 19292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:55:37.685122 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.671304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37300 (local address 127.15.239.254:36243)
0810 04:55:37.671357 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.671360 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.676265 (+ 4905us) server_negotiation.cc:407] Connection header received
0810 04:55:37.676295 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.676296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.676310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.676373 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.677339 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.678142 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.679328 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.679639 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.679683 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.681728 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.681729 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.681729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.681737 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.683677 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.684195 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.684197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.684197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.684259 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.684483 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.684484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.684484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.684623 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.684730 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.684932 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.685019 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 04:55:37.680482 19292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:55:37.686918 19109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.671577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.15.239.253:37979)
0810 04:55:37.671639 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.671641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.676393 (+ 4752us) server_negotiation.cc:407] Connection header received
0810 04:55:37.676493 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.676495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.676509 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.676541 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.677336 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.678138 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.679321 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.679630 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.679675 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.681612 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.681613 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.681614 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.681621 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.683611 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.684191 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.684193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.684194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.684264 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.686178 (+ 1914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.686179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.686179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.686332 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.686418 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.686657 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.686748 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 04:55:37.688592 19218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:37.670889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47652 (local address 127.15.239.252:33093)
0810 04:55:37.670945 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.670947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.676235 (+ 5288us) server_negotiation.cc:407] Connection header received
0810 04:55:37.676335 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.676337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.676355 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.676386 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.680905 (+ 4519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.681664 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.682715 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:37.683019 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:37.683066 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:37.685148 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 04:55:37.685149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 04:55:37.685150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 04:55:37.685157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 04:55:37.687011 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.687645 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.687646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.687647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.687713 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 04:55:37.687928 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 04:55:37.687929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 04:55:37.687929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 04:55:37.688098 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 04:55:37.688196 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:37.688390 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 04:55:37.688487 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 04:55:37.695022 19175 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [term 1 FOLLOWER]: Refusing update from remote peer 38e6d24fa8864419bc3d8c12977ad446: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:55:37.695022 19060 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [term 1 FOLLOWER]: Refusing update from remote peer 38e6d24fa8864419bc3d8c12977ad446: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 04:55:37.696051 18921 tablet.cc:2369] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:55:37.695968 19263 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:37.696206 19263 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:55:37.698148 19245 sys_catalog.cc:455] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e6d24fa8864419bc3d8c12977ad446. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.698282 19245 sys_catalog.cc:458] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.700063 19225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e6d24fa8864419bc3d8c12977ad446. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.700201 19225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.701759 19263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.701865 19263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:37.702278 19225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.702368 19225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.702747 19294 mvcc.cc:205] Tried to move back new op lower bound from 7316839373594984448 to 7316839373506891776. Current Snapshot: MvccSnapshot[applied={T|T < 7316839373594984448}]
I20260810 04:55:37.703933 19304 mvcc.cc:205] Tried to move back new op lower bound from 7316839373594984448 to 7316839373506891776. Current Snapshot: MvccSnapshot[applied={T|T < 7316839373594984448}]
I20260810 04:55:37.704334 19290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.704470 19290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446 [sys.catalog]: This master's current role is: LEADER
I20260810 04:55:37.704857 19245 sys_catalog.cc:455] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38e6d24fa8864419bc3d8c12977ad446" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e6d24fa8864419bc3d8c12977ad446" member_type: VOTER last_known_addr { host: "127.15.239.254" port: 36243 } } peers { permanent_uuid: "26bcc310f5744f54b846fdb1723362ed" member_type: VOTER last_known_addr { host: "127.15.239.253" port: 37979 } } peers { permanent_uuid: "c622d0bcc6504e9586906053fc04fa08" member_type: VOTER last_known_addr { host: "127.15.239.252" port: 33093 } } }
I20260810 04:55:37.704967 19245 sys_catalog.cc:458] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 04:55:37.705648 19300 mvcc.cc:205] Tried to move back new op lower bound from 7316839373594984448 to 7316839373506891776. Current Snapshot: MvccSnapshot[applied={T|T < 7316839373594984448}]
I20260810 04:55:37.712311 19292 catalog_manager.cc:1347] Generated new cluster ID: 45f7858c8b9440a2bed430ddc495c982
I20260810 04:55:37.712385 19292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:55:37.738164 19292 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:55:37.739058 19292 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:55:37.746029 19292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38e6d24fa8864419bc3d8c12977ad446: Generated new TSK 0
I20260810 04:55:37.746258 19292 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 04:55:37.786125 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.783960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35212 (local address 127.15.239.253:37979)
0810 04:55:37.784049 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.784052 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.785231 (+ 1179us) server_negotiation.cc:407] Connection header received
0810 04:55:37.785399 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.785401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.785417 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.785457 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.786025 (+ 568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35212: BlockingRecv error: recv got EOF from 127.0.0.1:35212 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260810 04:55:37.787061 18993 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.784483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.15.239.254:36243)
0810 04:55:37.784538 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.784540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.786443 (+ 1903us) server_negotiation.cc:407] Connection header received
0810 04:55:37.786556 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.786557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.786571 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.786606 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.786977 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37308: BlockingRecv error: recv got EOF from 127.0.0.1:37308 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260810 04:55:37.788012 19218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.784902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47666 (local address 127.15.239.252:33093)
0810 04:55:37.784966 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.784969 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.787324 (+ 2355us) server_negotiation.cc:407] Connection header received
0810 04:55:37.787444 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.787446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.787459 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.787521 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.787932 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47666: BlockingRecv error: recv got EOF from 127.0.0.1:47666 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 04:55:37.791082 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.790157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35222 (local address 127.15.239.253:37979)
0810 04:55:37.790201 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.790203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.790452 (+ 249us) server_negotiation.cc:407] Connection header received
0810 04:55:37.790573 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.790574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.790600 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.790634 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.791019 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35222: BlockingRecv error: recv got EOF from 127.0.0.1:35222 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 04:55:37.794584 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.793689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35234 (local address 127.15.239.253:37979)
0810 04:55:37.793728 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.793730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.794009 (+ 279us) server_negotiation.cc:407] Connection header received
0810 04:55:37.794116 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.794117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.794129 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.794159 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.794528 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35234: BlockingRecv error: recv got EOF from 127.0.0.1:35234 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:55:37.798666 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.797808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35250 (local address 127.15.239.253:37979)
0810 04:55:37.797848 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.797850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.798110 (+ 260us) server_negotiation.cc:407] Connection header received
0810 04:55:37.798215 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.798216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.798226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.798271 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.798612 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35250: BlockingRecv error: recv got EOF from 127.0.0.1:35250 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 04:55:37.804988 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.803955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35256 (local address 127.15.239.253:37979)
0810 04:55:37.803998 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.804000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.804360 (+ 360us) server_negotiation.cc:407] Connection header received
0810 04:55:37.804473 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.804474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.804486 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.804517 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.804928 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35256: BlockingRecv error: recv got EOF from 127.0.0.1:35256 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 04:55:37.815469 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.814437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35272 (local address 127.15.239.253:37979)
0810 04:55:37.814491 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.814494 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.814812 (+ 318us) server_negotiation.cc:407] Connection header received
0810 04:55:37.814917 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.814918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.814930 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.814961 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.815403 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35272: BlockingRecv error: recv got EOF from 127.0.0.1:35272 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 04:55:37.834478 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.833272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35284 (local address 127.15.239.253:37979)
0810 04:55:37.833332 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.833334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.833711 (+ 377us) server_negotiation.cc:407] Connection header received
0810 04:55:37.833835 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.833836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.833853 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.833887 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.834397 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35284: BlockingRecv error: recv got EOF from 127.0.0.1:35284 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 04:55:37.869271 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.868205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35300 (local address 127.15.239.253:37979)
0810 04:55:37.868290 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.868292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.868492 (+ 200us) server_negotiation.cc:407] Connection header received
0810 04:55:37.868601 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.868602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.868619 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.868669 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.869175 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35300: BlockingRecv error: recv got EOF from 127.0.0.1:35300 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 04:55:37.935859 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:37.934958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35314 (local address 127.15.239.253:37979)
0810 04:55:37.935026 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:37.935028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:37.935125 (+ 97us) server_negotiation.cc:407] Connection header received
0810 04:55:37.935241 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:37.935242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:37.935258 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:37.935334 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:37.935760 (+ 426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35314: BlockingRecv error: recv got EOF from 127.0.0.1:35314 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 04:55:38.066524 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:38.065495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35324 (local address 127.15.239.253:37979)
0810 04:55:38.065586 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.065588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.065602 (+ 14us) server_negotiation.cc:407] Connection header received
0810 04:55:38.065688 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.065689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.065702 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.065797 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:38.066424 (+ 627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35324: BlockingRecv error: recv got EOF from 127.0.0.1:35324 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 04:55:38.324857 19109 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 04:55:38.324001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35334 (local address 127.15.239.253:37979)
0810 04:55:38.324129 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.324132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.324143 (+ 11us) server_negotiation.cc:407] Connection header received
0810 04:55:38.324189 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.324190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.324202 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.324274 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 04:55:38.324759 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35334: BlockingRecv error: recv got EOF from 127.0.0.1:35334 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260810 04:55:38.640007 19242 catalog_manager.cc:1259] Loaded cluster ID: 45f7858c8b9440a2bed430ddc495c982
I20260810 04:55:38.640149 19242 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: loading cluster ID for follower catalog manager: success
I20260810 04:55:38.641142 19242 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: acquiring CA information for follower catalog manager: success
I20260810 04:55:38.641677 19242 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 26bcc310f5744f54b846fdb1723362ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:55:38.644384 19260 catalog_manager.cc:1259] Loaded cluster ID: 45f7858c8b9440a2bed430ddc495c982
I20260810 04:55:38.644459 19260 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: loading cluster ID for follower catalog manager: success
I20260810 04:55:38.645287 19260 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: acquiring CA information for follower catalog manager: success
I20260810 04:55:38.645565 19260 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c622d0bcc6504e9586906053fc04fa08: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 04:55:38.842073 19402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:38.838576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35336 (local address 127.15.239.253:37979)
0810 04:55:38.838737 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.838740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.838827 (+ 87us) server_negotiation.cc:407] Connection header received
0810 04:55:38.838960 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.838961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.839047 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.839155 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:38.839380 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.840009 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.840983 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.841286 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.841377 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:38.841609 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:38.841768 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:38.841887 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:38.841910 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 04:55:38.841936 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260810 04:55:38.847011 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:38.844368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.15.239.252:33093)
0810 04:55:38.844519 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.844521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.844566 (+ 45us) server_negotiation.cc:407] Connection header received
0810 04:55:38.844654 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.844655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.844703 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.844782 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:38.844939 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.845445 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.846179 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.846434 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.846507 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:38.846618 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:38.846748 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:38.846810 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:38.846903 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 04:55:38.846925 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260810 04:55:38.852491 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:38.849390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47698 (local address 127.15.239.252:33093)
0810 04:55:38.849429 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.849431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.849440 (+ 9us) server_negotiation.cc:407] Connection header received
0810 04:55:38.849504 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.849504 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.849513 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.849566 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:38.849821 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.850373 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.851444 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.851792 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.851877 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:38.852065 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:38.852110 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:38.852177 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:38.852348 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 04:55:38.852386 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 04:55:38.852746 19426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:38.849115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37316 (local address 127.15.239.254:36243)
0810 04:55:38.849331 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.849334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.849342 (+ 8us) server_negotiation.cc:407] Connection header received
0810 04:55:38.849406 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.849408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.849485 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.849576 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:38.849677 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.850628 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.851611 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.851902 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.851971 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:38.852221 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:38.852357 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:38.852588 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:38.852608 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 04:55:38.852641 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":68,"threads_started":1}
I20260810 04:55:38.852982 19402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 04:55:38.849248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35348 (local address 127.15.239.253:37979)
0810 04:55:38.849305 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 04:55:38.849308 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 04:55:38.849744 (+ 436us) server_negotiation.cc:407] Connection header received
0810 04:55:38.849782 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 04:55:38.849783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 04:55:38.849797 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 04:55:38.849874 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 04:55:38.849981 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.850776 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.851790 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 04:55:38.852165 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 04:55:38.852207 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 04:55:38.852468 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 04:55:38.852509 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 04:55:38.852570 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 04:55:38.852856 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 04:55:38.852886 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 04:55:38.854671 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18888
I20260810 04:55:38.890995 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 18999
I20260810 04:55:38.907411 16319 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvaRG_7/build/release/bin/kudu with pid 19113
2026-08-10T04:55:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3320 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6578 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (303518 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST